00000001:02000400:3.0F:1789120620.222574:0:3300:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1789120641.038811:0:3520:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1789120643.371591:0:3583:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 587 MB/s 00000001:01000000:1.0F:1789120643.622753:0:3583:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 607 MB/s 00000001:01000000:0.0:1789120643.871871:0:3583:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4823 MB/s 00000020:02000000:0.0:1789120644.985768:0:3612:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_139_gd84534a 00000400:02000000:1.0:1789120646.241259:0:3627:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.132@tcp [8/256/0/180] 00008000:02000000:1.0:1789120649.895409:0:3777:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789120715.245688:0:5745:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789120729.571571:0:6495:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789120729.571578:0:6495:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1789120729.571579:0:6495:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789120729.573206:0:6495:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000001e3eeaac 00000080:02000400:2.0:1789120729.573220:0:6495:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789120729.592758:0:6495:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789120729.592774:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789120729.592811:0:6495:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000009d62c4db) 00000020:00000080:2.0:1789120729.592858:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789120729.687040:0:6495:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789120729.687133:0:6495:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:2.0:1789120729.717287:0:6495:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789120729.717712:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789120729.717721:0:6495:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789120729.717736:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a830ee2c 00000020:01000004:2.0:1789120729.717743:0:6495:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1789120729.717749:0:6495:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789120729.717754:0:6495:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001e3eeaac from MGS 00000020:01000004:2.0:1789120729.717758:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789120729.717769:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000c4a76a8c) 00000020:00000080:2.0:1789120729.717780:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789120729.717885:0:6495:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001e3eeaac from MGS, refs=2 00080000:01000000:2.0:1789120729.717891:0:6495:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789120729.717896:0:6495:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a830ee3a 00000100:00100000:2.0:1789120729.718004:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789120729.718149:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789120729.718155:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789120729.722813:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789120729.722958:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789120729.730362:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120729.730752:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789120729.730760:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789120729.731738:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789120729.731748:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1789120729.732518:0:6495:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1789120729.732526:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789120729.738359:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120729.738366:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120729.738368:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120729.740978:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120729.740984:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120729.740986:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120729.741588:0:6495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789120729.752249:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789120729.990933:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3143 MB/s 00000001:01000000:0.0:1789120730.240907:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3323 MB/s 00000001:01000000:2.0:1789120730.491995:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 462 MB/s 00000001:01000000:2.0:1789120730.743367:0:6495:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 764 MB/s 00080000:10000000:2.0:1789120730.754587:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:1.0:1789120730.777978:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789120730.789606:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789120730.792088:0:6509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789120730.792158:0:6495:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789120730.792225:0:6495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1789120730.792542:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1789120730.792571:0:6495:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789120730.793048:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120730.793221:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789120730.793228:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789120730.809972:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789120730.809989:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789120730.811193:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789120730.811201:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789120730.812991:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789120730.813021:0:6495:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.132@tcp' 00000020:01000004:0.0:1789120730.813024:0:6495:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789120730.813076:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.132@tcp (typ=mgc) 00000020:00000080:0.0:1789120730.813102:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.132@tcp (0000000079cbe89e) 00000020:00000080:0.0:1789120730.813131:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789120730.813264:0:6495:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000df505163@MGC192.168.202.132@tcp: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789120730.813420:0:6495:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.132@tcp-0 is initialized 00000040:01000000:0.0:1789120730.813427:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789120730.830679:0:6515:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789120730.830742:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.132@tcp (uuid 03a1864a-46e4-4762-8a00-3ced97b06903) 00000020:00000080:0.0:1789120730.830773:0:6495:0:(genops.c:1385:class_connect()) connect: client 03a1864a-46e4-4762-8a00-3ced97b06903, cookie 0xb74d2367a830ee48 00000100:00080000:0.0:1789120730.830786:0:6495:0:(import.c:510:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789120730.830792:0:6495:0:(import.c:624:import_select_connection()) MGC192.168.202.132@tcp: import 00000000df505163 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789120730.830848:0:6495:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f1581a18 x1876028970500224/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789120730.830873:0:6495:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 03a1864a-46e4-4762-8a00-3ced97b06903->MGS 00000020:01000004:0.0:1789120730.830891:0:6495:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789120730.830921:0:6495:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789120730.830936:0:6495:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000095ef05f7) 00000020:00000080:0.0:1789120730.830950:0:6495:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:3.0:1789120730.836311:0:6514:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1789120730.839778:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f1581a18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:03a1864a-46e4-4762-8a00-3ced97b06903:3643:1876028970500224:0@lo:250: 00000100:00100000:1.0:1789120730.839913:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120730.841306:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970500224 00000100:00100000:3.0:1789120730.841319:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970500224 00000100:00100000:3.0:1789120730.841378:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789120730.841386:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a53cdbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1876028970500224:12345-0@lo:250: 00010000:00080000:3.0:1789120730.841417:0:6510:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 03a1864a-46e4-4762-8a00-3ced97b06903@0@lo t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:3.0:1789120730.841471:0:6510:0:(genops.c:1385:class_connect()) connect: client 03a1864a-46e4-4762-8a00-3ced97b06903, cookie 0xb74d2367a830ee56 00000100:00080000:3.0:1789120730.841854:0:6510:0:(import.c:65:import_set_state_nolock()) 000000002bca37c0 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120730.841968:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a53cdbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+5:3643:x1876028970500224:12345-0@lo:250: Request processed in 580us (2055us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120730.841977:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120730.842691:0:3643:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789120730.842703:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.132@tcp: connect to target with instance 0 00000100:00080000:1.0:1789120730.842712:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789120730.842718:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789120730.842721:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000df505163 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789120730.842725:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789120730.842736:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789120730.842742:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f1581a18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:03a1864a-46e4-4762-8a00-3ced97b06903:3643:1876028970500224:0@lo:250: 00000100:00100000:0.0:1789120730.887464:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789120730.887745:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789120730.887754:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789120730.889329:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789120730.889342:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789120730.890146:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789120730.890154:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789120730.891331:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120730.891547:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789120730.891553:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789120730.898194:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789120730.898210:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789120731.026095:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120731.026337:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789120731.026359:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789120731.033597:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789120731.033612:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1789120731.035279:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120731.035501:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789120731.035960:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1789120731.036992:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789120731.037003:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789120731.038180:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120731.038379:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789120731.038391:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789120731.040214:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789120731.040226:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1789120731.041260:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789120731.041453:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789120731.041459:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789120731.042358:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789120731.042369:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789120731.077186:0:6495:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789120731.079244:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789120731.079266:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789120731.091284:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789120731.091302:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789120731.100558:0:6495:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789120731.100579:0:6495:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789120731.102973:0:6495:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789120731.103013:0:6495:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:3.0:1789120731.103020:0:6495:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789120731.103131:0:6495:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789120731.103169:0:6495:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.132@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789120731.103174:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789120731.103176:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789120731.103177:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120731.103179:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120731.103180:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120731.103181:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120731.103182:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789120731.103184:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789120731.103185:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120731.103187:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120731.103188:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120731.103190:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789120731.103193:0:6495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789120731.103195:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789120731.103196:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789120731.103197:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120731.103198:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120731.103200:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120731.103201:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120731.103202:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789120731.103208:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789120731.103209:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120731.103210:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120731.103210:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120731.103211:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789120731.103240:0:6495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789120731.103267:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000035ffc68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500352:0@lo:253: 00000100:00100000:3.0:1789120731.103357:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120731.105411:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970500352 00000100:00100000:2.0:1789120731.105424:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970500352 00000100:00100000:2.0:1789120731.105481:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120731.105490:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b005cb62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+5:6495:x1876028970500352:12345-0@lo:253: 20000000:01000000:2.0:1789120731.105561:0:6513:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789120731.105564:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 00000100:00100000:3.0:1789120731.105666:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 000000004c7dd426 going to sleep for 11 seconds 10000000:01000000:2.0:1789120731.106221:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1789120731.106334:0:6513:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1789120731.106700:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120731.108259:0:6535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789120731.110941:0:6513:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789120731.110951:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789120731.110959:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789120731.110962:0:6513:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789120731.111009:0:6513:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789120731.111307:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789120731.111579:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789120731.111596:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789120731.111616:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789120731.111632:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789120731.111817:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789120731.112017:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789120731.112025:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789120731.112038:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789120731.112044:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789120731.112056:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789120731.112061:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789120731.112074:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789120731.112090:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789120731.112119:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789120731.112124:0:6513:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789120731.112133:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789120731.112262:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789120731.112273:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789120731.112288:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789120731.112303:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789120731.112320:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789120731.112330:0:6513:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789120731.112615:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789120731.112629:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789120731.112718:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789120731.112734:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789120731.112747:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789120731.112756:0:6513:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789120731.112781:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789120731.112789:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789120731.112799:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789120731.112812:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789120731.113053:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789120731.113075:0:6513:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789120731.113083:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789120731.118564:0:6536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789120731.118946:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789120731.118979:0:6513:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.132@tcp for mdt 20000000:01000000:3.0:1789120731.118981:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:3.0:1789120731.118998:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789120731.119005:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789120731.119017:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789120731.119022:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:3.0:1789120731.119034:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789120731.119041:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789120731.119053:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789120731.119066:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789120731.119095:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789120731.119106:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789120731.119110:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789120731.119157:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789120731.119160:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789120731.119666:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1789120731.119907:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1789120731.119930:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1789120731.119944:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:3.0:1789120731.119954:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789120731.119956:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789120731.120344:0:6538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789120731.120484:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789120731.120507:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789120731.120523:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:2.0:1789120731.120534:0:6513:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789120731.120537:0:6513:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1789120731.120542:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789120731.120545:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1789120731.120551:0:6513:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1789120731.120558:0:6513:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789120731.121072:0:6539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1789120731.121173:0:6513:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1789120731.131992:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1789120731.132028:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1789120731.132042:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1789120731.132063:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789120731.132088:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000000575abd1/0xb74d2367a830ee5d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.132107:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000575abd1/0xb74d2367a830ee5d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.132119:0:6513:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000575abd1/0xb74d2367a830ee5d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.132126:0:6513:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000000575abd1/0xb74d2367a830ee5d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.132133:0:6513:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000000575abd1/0xb74d2367a830ee5d lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.132139:0:6513:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000000575abd1/0xb74d2367a830ee5d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.132163:0:6513:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000575abd1 already unused, calling callback (0000000026fe3ef7) 00010000:00010000:3.0:1789120731.132167:0:6513:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000000575abd1/0xb74d2367a830ee5d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.132175:0:6513:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000000575abd1/0xb74d2367a830ee5d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.132188:0:6513:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000000575abd1/0xb74d2367a830ee5d lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.132196:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000000575abd1/0xb74d2367a830ee5d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.132202:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000575abd1/0xb74d2367a830ee5d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789120731.132219:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789120731.152336:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b005cb62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+5:6495:x1876028970500352:12345-0@lo:253: Request processed in 46839us (48971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120731.152356:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789120731.152572:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000035ffc68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500352:0@lo:253: 10000000:01000000:0.0:1789120731.152589:0:6495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789120731.152593:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789120731.152595:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789120731.152596:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120731.152597:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1789120731.152599:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120731.152600:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120731.152602:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120731.152603:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789120731.152605:0:6495:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1789120731.152607:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120731.152609:0:6495:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789120731.152630:0:6495:0:(tgt_mount.c:101:server_register_mount()) register mount 000000001e3eeaac from lustre-MDT0000 10000000:01000000:0.0:1789120731.152811:0:6495:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789120731.152815:0:6495:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789120731.153129:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9468ab900000 10000000:01000000:0.0:1789120731.153138:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789120731.153148:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9468ab900000 from 1 10000000:01000000:0.0:1789120731.153151:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789120731.153211:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.153223:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.153232:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120731.153264:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c610c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500480:0@lo:101: 00000100:00100000:0.0:1789120731.153314:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120731.153419:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fda1f960 going to sleep for 11 seconds 00000100:00100000:3.0:1789120731.153563:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970500480 00000100:00100000:3.0:1789120731.153570:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970500480 00000100:00100000:3.0:1789120731.153649:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120731.153658:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a46fa57a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+5:6495:x1876028970500480:12345-0@lo:101: 00010000:00010000:3.0:1789120731.153671:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120731.153686:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000575abd1/0xb74d2367a830ee6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830ee64 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.153707:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000575abd1/0xb74d2367a830ee6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830ee64 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.153735:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000575abd1/0xb74d2367a830ee6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ee64 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.153745:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000575abd1, rc 0) 00000100:00100000:3.0:1789120731.153791:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a46fa57a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+6:6495:x1876028970500480:12345-0@lo:101: Request processed in 135us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120731.153798:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789120731.153880:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c610c33 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500480:0@lo:101: 00010000:00010000:1.0:1789120731.153893:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.153901:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120731.153978:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500608:0@lo:501: 00000100:00100000:1.0:1789120731.154009:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120731.157134:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b020b1b5 going to sleep for 11 seconds 00000100:00100000:0.0:1789120731.157507:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970500608 00000100:00100000:0.0:1789120731.157518:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970500608 00000100:00100000:0.0:1789120731.157578:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789120731.157586:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab55598a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+6:6495:x1876028970500608:12345-0@lo:501: 00000100:00100000:0.0:1789120731.158063:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab55598a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+6:6495:x1876028970500608:12345-0@lo:501: Request processed in 477us (4052us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120731.158073:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789120731.158295:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500608:0@lo:501: 10000000:01000000:1.0:1789120731.158341:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789120731.158523:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.158534:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120731.158545:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946886899000 10000000:01000000:1.0:1789120731.158550:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789120731.158556:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff946886899000 10000000:01000000:1.0:1789120731.158558:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789120731.158561:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff946886899000 from 1 10000000:01000000:1.0:1789120731.158564:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789120731.158599:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 0000000054f15cf5/0xb74d2367a830ee72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.158606:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 0000000054f15cf5/0xb74d2367a830ee72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.158615:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 0000000054f15cf5/0xb74d2367a830ee72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120731.158632:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500736:0@lo:101: 00000100:00100000:1.0:1789120731.158698:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120731.158861:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970500736 00000100:00100000:3.0:1789120731.158867:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970500736 00000100:00100000:3.0:1789120731.158909:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789120731.158915:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e925ff38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+6:6495:x1876028970500736:12345-0@lo:101: 00010000:00010000:3.0:1789120731.158926:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120731.158941:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011eb964d/0xb74d2367a830ee79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830ee72 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.158962:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011eb964d/0xb74d2367a830ee79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830ee72 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.158974:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011eb964d/0xb74d2367a830ee79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ee72 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.158982:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011eb964d, rc 0) 00000100:00100000:1.0:1789120731.159046:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b020b1b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789120731.159318:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e925ff38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+7:6495:x1876028970500736:12345-0@lo:101: Request processed in 403us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120731.159326:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789120731.159515:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500736:0@lo:101: 00010000:00010000:1.0:1789120731.159529:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 0000000054f15cf5/0xb74d2367a830ee72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.159537:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 0000000054f15cf5/0xb74d2367a830ee72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120731.159565:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789120731.159613:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 0000000054f15cf5/0xb74d2367a830ee72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.159621:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 0000000054f15cf5/0xb74d2367a830ee72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120731.159628:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789120731.159642:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789120731.159647:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff946886899000 10000000:01000000:1.0:1789120731.159650:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789120731.159653:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1789120731.159654:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789120731.159671:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.159677:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.159684:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120731.159697:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500864:0@lo:101: 00000100:00100000:1.0:1789120731.159736:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120731.159794:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b020b1b5 going to sleep for 11 seconds 00000100:00100000:3.0:1789120731.159994:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970500864 00000100:00100000:3.0:1789120731.160000:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970500864 00000100:00100000:3.0:1789120731.160100:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789120731.160114:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f0a5c96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+7:6495:x1876028970500864:12345-0@lo:101: 00010000:00010000:3.0:1789120731.160125:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120731.160134:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009fb4546b/0xb74d2367a830ee87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830ee80 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.160150:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009fb4546b/0xb74d2367a830ee87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830ee80 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.160158:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009fb4546b/0xb74d2367a830ee87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ee80 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.160165:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009fb4546b, rc 0) 00000100:00100000:3.0:1789120731.160206:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f0a5c96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+8:6495:x1876028970500864:12345-0@lo:101: Request processed in 93us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120731.160212:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789120731.160299:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500864:0@lo:101: 00010000:00010000:1.0:1789120731.160308:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.160325:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120731.160403:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500992:0@lo:501: 00000100:00100000:1.0:1789120731.160430:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120731.163322:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b020b1b5 going to sleep for 11 seconds 00000100:00100000:2.0:1789120731.163371:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970500992 00000100:00100000:2.0:1789120731.163380:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970500992 00000100:00100000:0.0:1789120731.163503:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789120731.163514:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082cb47f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+8:6495:x1876028970500992:12345-0@lo:501: 00000100:00100000:0.0:1789120731.163731:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082cb47f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+9:6495:x1876028970500992:12345-0@lo:501: Request processed in 219us (3300us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120731.163739:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789120731.164007:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970500992:0@lo:501: 00000100:00100000:1.0:1789120731.164057:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970501120:0@lo:503: 00000100:00100000:1.0:1789120731.164119:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120731.164146:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b020b1b5 going to sleep for 11 seconds 00000100:00100000:0.0:1789120731.164203:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970501120 00000100:00100000:0.0:1789120731.164207:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970501120 00000100:00100000:0.0:1789120731.164229:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789120731.164234:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004dcdd9f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+9:6495:x1876028970501120:12345-0@lo:503: 00000100:00100000:0.0:1789120731.164343:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004dcdd9f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+9:6495:x1876028970501120:12345-0@lo:503: Request processed in 108us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120731.164350:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789120731.164492:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970501120:0@lo:503: 00000100:00100000:0.0:1789120731.165351:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001aa2478d pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:6540:1876028970501248:0@lo:502: 00000100:00100000:0.0:1789120731.165531:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120731.165651:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set 000000000276131e going to sleep for 11 seconds 00000100:00100000:3.0:1789120731.165919:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970501248 00000100:00100000:3.0:1789120731.165926:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970501248 00000100:00100000:2.0:1789120731.166029:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789120731.166039:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2ee0459 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+9:6540:x1876028970501248:12345-0@lo:502: 00000100:00100000:2.0:1789120731.166163:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2ee0459 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+9:6540:x1876028970501248:12345-0@lo:502: Request processed in 125us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120731.166171:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789120731.166281:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001aa2478d pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:6540:1876028970501248:0@lo:502: 00000020:01000000:0.0:1789120731.166309:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120731.166321:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120731.166324:0:6540:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789120731.166329:0:6540:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789120731.166332:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789120731.166348:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000536d88b3) 00000020:00000080:0.0:1789120731.166369:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789120731.166375:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789120731.166496:0:6540:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789120731.166504:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a830ee95 00000020:00000080:0.0:1789120731.166791:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789120731.166797:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120731.166800:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120731.166801:0:6540:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789120731.166804:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120731.166808:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120731.166810:0:6540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789120731.166813:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789120731.171133:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001a3daa88) 00000020:00000080:0.0:1789120731.171172:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789120731.171193:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789120731.171196:0:6540:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789120731.171199:0:6540:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789120731.171223:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789120731.171372:0:6540:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001e3eeaac from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789120731.171418:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000006164823a) 00000020:00000080:0.0:1789120731.171428:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789120731.171521:0:6540:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789120731.171529:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a830eeaa 00000020:00000080:0.0:1789120731.171713:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789120731.171947:0:6540:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789120731.171954:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb74d2367a830eeb1 00080000:01000000:0.0:1789120731.171962:0:6540:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789120731.171967:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a830eeb8 00080000:10000000:0.0:1789120731.172446:0:6540:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1789120731.172600:0:6540:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1789120731.182257:0:6540:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789120731.339868:0:6540:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789120731.340241:0:6540:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789120731.350022:0:6540:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789120731.350806:0:6540:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789120731.357050:0:6540:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000036425fde) 00000020:00000080:0.0:1789120731.357078:0:6540:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1789120731.357210:0:6540:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789120731.357221:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a830eec6 00000020:00000080:3.0:1789120731.365728:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1789120731.371201:0:6540:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:3.0:1789120731.374286:0:6540:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:2.0:1789120731.382443:0:6540:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:2.0:1789120731.385205:0:6540:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:2.0:1789120731.391419:0:6540:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:0.0:1789120731.406618:0:6540:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:0.0:1789120731.411265:0:6540:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb74d2367a830eecd 00000020:00000080:0.0:1789120731.412160:0:6540:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789120731.412174:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120731.412181:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120731.412183:0:6540:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789120731.412186:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120731.412190:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120731.412192:0:6540:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789120731.412195:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789120731.412196:0:6540:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789120731.412200:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120731.412202:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120731.412203:0:6540:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789120731.412205:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120731.412210:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120731.412217:0:6540:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789120731.412222:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789120731.412310:0:6540:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789120731.412401:0:6540:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001aa2478d pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:6540:1876028970501376:0@lo:502: 00000100:00100000:0.0:1789120731.412520:0:6540:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120731.412593:0:6540:0:(client.c:2715:ptlrpc_set_wait()) set 000000000276131e going to sleep for 11 seconds 00000100:00100000:1.0:1789120731.412763:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970501376 00000100:00100000:1.0:1789120731.412771:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970501376 00000100:00100000:1.0:1789120731.412861:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789120731.412872:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000049e6b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+9:6540:x1876028970501376:12345-0@lo:502: 00000100:00100000:1.0:1789120731.413016:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000049e6b9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+9:6540:x1876028970501376:12345-0@lo:502: Request processed in 145us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120731.413024:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789120731.413197:0:6540:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001aa2478d pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:6540:1876028970501376:0@lo:502: 00000020:01000000:0.0:1789120731.413237:0:6540:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120731.413254:0:6540:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120731.413256:0:6540:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1789120731.413260:0:6540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1789120731.413502:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1789120731.413526:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789120731.413547:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.413560:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120731.413582:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946886899000 from 1 10000000:01000000:1.0:1789120731.413585:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789120731.413629:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.413637:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.413646:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120731.413663:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970501504:0@lo:101: 00000100:00100000:1.0:1789120731.413722:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120731.413760:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e60c3c31 going to sleep for 11 seconds 00000100:00100000:3.0:1789120731.414366:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970501504 00000100:00100000:3.0:1789120731.414383:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970501504 00000100:00100000:3.0:1789120731.414455:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789120731.414465:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd535576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+9:6495:x1876028970501504:12345-0@lo:101: 00010000:00010000:3.0:1789120731.414486:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120731.414523:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f6407ee2/0xb74d2367a830eedb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830eed4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.414553:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f6407ee2/0xb74d2367a830eedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830eed4 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.414564:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f6407ee2/0xb74d2367a830eedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830eed4 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.414573:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f6407ee2, rc 0) 00000100:00100000:3.0:1789120731.414656:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd535576 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+10:6495:x1876028970501504:12345-0@lo:101: Request processed in 193us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120731.414663:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789120731.414869:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970501504:0@lo:101: 00010000:00010000:1.0:1789120731.414893:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.414904:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120731.415466:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970501632:0@lo:256: 00000100:00100000:1.0:1789120731.415531:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120731.415577:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e60c3c31 going to sleep for 11 seconds 00000100:00100000:0.0:1789120731.417893:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970501632 00000100:00100000:0.0:1789120731.417915:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970501632 00000100:00100000:0.0:1789120731.417999:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789120731.418010:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c59e491 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+10:6495:x1876028970501632:12345-0@lo:256: 20000000:01000000:0.0:1789120731.418048:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789120731.418057:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789120731.418205:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c59e491 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+10:6495:x1876028970501632:12345-0@lo:256: Request processed in 197us (2674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120731.418214:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789120731.418377:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970501632:0@lo:256: 10000000:01000000:1.0:1789120731.419100:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789120731.419127:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.419156:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120731.419167:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946886899000 from 1 10000000:01000000:1.0:1789120731.419170:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789120731.419213:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.419221:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.419230:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120731.419265:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970501760:0@lo:101: 00000100:00100000:1.0:1789120731.419325:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120731.419369:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e60c3c31 going to sleep for 11 seconds 00000100:00100000:3.0:1789120731.419862:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970501760 00000100:00100000:3.0:1789120731.419870:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970501760 00000100:00100000:3.0:1789120731.419919:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789120731.419928:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c307ff6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+10:6495:x1876028970501760:12345-0@lo:101: 00010000:00010000:3.0:1789120731.419944:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120731.419961:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef4be510/0xb74d2367a830eee9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830eee2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.419988:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef4be510/0xb74d2367a830eee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830eee2 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.419999:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef4be510/0xb74d2367a830eee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830eee2 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.420010:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef4be510, rc 0) 00000100:00100000:3.0:1789120731.420068:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c307ff6e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+11:6495:x1876028970501760:12345-0@lo:101: Request processed in 142us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120731.420089:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789120731.420206:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970501760:0@lo:101: 00010000:00010000:1.0:1789120731.420222:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.420231:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120731.420318:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970501888:0@lo:501: 00000100:00100000:1.0:1789120731.420353:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120731.420385:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e60c3c31 going to sleep for 11 seconds 00000100:00100000:3.0:1789120731.420447:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970501888 00000100:00100000:3.0:1789120731.420451:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970501888 00000100:00100000:3.0:1789120731.420522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789120731.420529:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1777c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+11:6495:x1876028970501888:12345-0@lo:501: 00000100:00100000:3.0:1789120731.420717:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1777c67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+11:6495:x1876028970501888:12345-0@lo:501: Request processed in 189us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120731.420724:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789120731.421036:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970501888:0@lo:501: 00000100:00100000:2.0:1789120731.421078:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000795117e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970502016:0@lo:503: 00000100:00100000:2.0:1789120731.421133:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120731.421320:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a35c9cb going to sleep for 11 seconds 00000100:00100000:1.0:1789120731.421363:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970502016 00000100:00100000:1.0:1789120731.421368:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970502016 00000100:00100000:1.0:1789120731.421453:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789120731.421460:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007edf3476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+11:6495:x1876028970502016:12345-0@lo:503: 00000040:00080000:1.0:1789120731.421505:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789120731.421591:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007edf3476 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+11:6495:x1876028970502016:12345-0@lo:503: Request processed in 131us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120731.421598:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120731.421962:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000795117e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970502016:0@lo:503: 00000040:00080000:0.0:1789120731.423382:0:6544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789120731.423748:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789120731.423773:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120731.423858:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120731.423875:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120731.423947:0:6495:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789120731.423950:0:6495:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946886899000 10000000:01000000:2.0:1789120731.423972:0:6495:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946886899000 10000000:01000000:2.0:1789120731.423977:0:6495:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789120731.423986:0:6495:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946886899000 from 1 10000000:01000000:2.0:1789120731.423989:0:6495:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789120731.424033:0:6495:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120731.424043:0:6495:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120731.424055:0:6495:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120731.424082:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000795117e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970502144:0@lo:101: 00000100:00100000:2.0:1789120731.424165:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120731.424219:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d5165f3b going to sleep for 11 seconds 00000100:00100000:1.0:1789120731.424303:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970502144 00000100:00100000:1.0:1789120731.424312:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970502144 00000100:00100000:1.0:1789120731.424360:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789120731.424369:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060313107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+11:6495:x1876028970502144:12345-0@lo:101: 00010000:00010000:1.0:1789120731.424383:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120731.424410:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038c5adaf/0xb74d2367a830eef7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830eef0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.424436:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038c5adaf/0xb74d2367a830eef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830eef0 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.424449:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038c5adaf/0xb74d2367a830eef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830eef0 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120731.424457:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038c5adaf, rc 0) 00000100:00100000:1.0:1789120731.424509:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060313107 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+12:6495:x1876028970502144:12345-0@lo:101: Request processed in 141us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120731.424517:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789120731.424702:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000795117e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970502144:0@lo:101: 00010000:00010000:2.0:1789120731.424718:0:6495:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120731.424728:0:6495:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120731.424793:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000795117e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970502272:0@lo:501: 00000100:00100000:2.0:1789120731.424863:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120731.424887:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d5165f3b going to sleep for 11 seconds 00000100:00100000:3.0:1789120731.424967:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970502272 00000100:00100000:3.0:1789120731.424972:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970502272 00000100:00100000:3.0:1789120731.425009:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789120731.425015:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046af2b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:6495:x1876028970502272:12345-0@lo:501: 00000100:00100000:3.0:1789120731.425156:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046af2b2d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:6495:x1876028970502272:12345-0@lo:501: Request processed in 142us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120731.425163:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789120731.425190:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000795117e1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970502272:0@lo:501: 00000100:00100000:3.0:1789120731.425216:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000035ffc68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970502400:0@lo:503: 00000100:00100000:3.0:1789120731.425288:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120731.425306:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970502400 00000100:00100000:3.0:1789120731.425309:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970502400 00000100:00100000:3.0:1789120731.425323:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789120731.425327:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cb14764 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:6495:x1876028970502400:12345-0@lo:503: 00000100:00100000:3.0:1789120731.425409:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cb14764 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:6495:x1876028970502400:12345-0@lo:503: Request processed in 81us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120731.425415:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789120731.425450:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 000000006d43f814 going to sleep for 11 seconds 00000100:00100000:3.0:1789120731.425461:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000035ffc68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970502400:0@lo:503: 00000100:00100000:3.0:1789120731.425881:0:6545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000035ffc68 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:6545:1876028970502528:0@lo:502: 00000100:00100000:3.0:1789120731.425919:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120731.425940:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970502528 00000100:00100000:3.0:1789120731.425943:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970502528 00000100:00100000:3.0:1789120731.425963:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789120731.425969:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ea706aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:6545:x1876028970502528:12345-0@lo:502: 00000100:00100000:3.0:1789120731.426041:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ea706aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:6545:x1876028970502528:12345-0@lo:502: Request processed in 73us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120731.426049:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789120731.426076:0:6545:0:(client.c:2715:ptlrpc_set_wait()) set 00000000860320d8 going to sleep for 11 seconds 00000100:00100000:3.0:1789120731.426089:0:6545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000035ffc68 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:6545:1876028970502528:0@lo:502: 00000020:01000004:3.0:1789120731.426151:0:6545:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789120731.426176:0:6545:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000f5c9d263) 00000020:00000080:3.0:1789120731.426197:0:6545:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789120731.426353:0:6545:0:(tgt_mount.c:153:server_get_mount()) get mount 000000001e3eeaac from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789120731.426358:0:6545:0:(tgt_mount.c:187:server_put_mount()) put mount 000000001e3eeaac from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789120731.426361:0:6545:0:(obd_mount.c:710:lustre_put_lsi()) put 000000001e3eeaac 4 00010000:00080000:2.0:1789120731.427746:0:6545:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000056d2a703@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789120731.433731:0:6545:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789120731.434301:0:6545:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789120731.434382:0:6545:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789120731.434406:0:6545:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb74d2367a830ef05 00000100:00080000:2.0:1789120731.434420:0:6545:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789120731.434426:0:6545:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000056d2a703 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789120731.434475:0:6545:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d804d3c4 x1876028970502656/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789120731.434551:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d804d3c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970502656:0@lo:38: 00000100:00100000:1.0:1789120731.434650:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789120731.434730:0:6545:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789120731.438690:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970502656 00000100:00100000:2.0:1789120731.438710:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970502656 00000100:00100000:2.0:1789120731.438772:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120731.438794:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051267fd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970502656:12345-0@lo:38: 00000100:00100000:2.0:1789120731.440205:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051267fd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970502656:12345-0@lo:38: Request processed in 1403us (5547us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789120731.440220:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120731.443294:0:6545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000908e2b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:6545:1876028970502784:0@lo:502: 00000100:00100000:2.0:1789120731.445128:0:6545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120731.445207:0:6545:0:(client.c:2715:ptlrpc_set_wait()) set 0000000027e7625a going to sleep for 11 seconds 00000100:00100000:1.0:1789120731.445427:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789120731.445458:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000056d2a703 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789120731.445463:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789120731.445468:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d804d3c4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970502656:0@lo:38: 00000100:00100000:3.0:1789120731.451442:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970502784 00000100:00100000:3.0:1789120731.451467:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970502784 00000100:00100000:3.0:1789120731.451575:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789120731.451585:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005bb7f4d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:6545:x1876028970502784:12345-0@lo:502: 00000100:00100000:3.0:1789120731.451835:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005bb7f4d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:6545:x1876028970502784:12345-0@lo:502: Request processed in 235us (6701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120731.451844:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789120731.455723:0:6545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000908e2b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:6545:1876028970502784:0@lo:502: 00000040:00080000:2.0:1789120731.455805:0:6545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1789120731.457504:0:6495:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1789120731.457565:0:6495:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789120731.457595:0:6495:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.457610:0:6495:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789120731.457675:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789120731.457677:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789120731.457679:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120731.457680:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120731.457681:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120731.457683:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120731.457684:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789120731.457685:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789120731.457688:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120731.457689:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120731.457691:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120731.457693:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789120731.457698:0:6495:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1789120731.457700:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789120731.457702:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789120731.457703:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120731.457704:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120731.457705:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120731.457706:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120731.457707:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789120731.457708:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789120731.457709:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120731.457710:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120731.457711:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120731.457712:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789120731.457745:0:6495:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789120731.457768:0:6495:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000035ffc68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970502912:0@lo:253: 00000100:00100000:3.0:1789120731.458996:0:6495:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120731.459052:0:6495:0:(client.c:2715:ptlrpc_set_wait()) set 000000000e67478d going to sleep for 11 seconds 00000100:00100000:1.0:1789120731.459276:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970502912 00000100:00100000:1.0:1789120731.459288:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970502912 00000100:00100000:1.0:1789120731.459358:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789120731.459368:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d677063e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+12:6495:x1876028970502912:12345-0@lo:253: 20000000:01000000:1.0:1789120731.459419:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789120731.459438:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789120731.470527:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789120731.470560:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789120731.470900:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789120731.470918:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789120731.470943:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.470968:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f6407ee2/0xb74d2367a830eedb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830eed4 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.470977:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.471028:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f6407ee2/0xb74d2367a830eedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830eed4 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120731.471044:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f6407ee2/0xb74d2367a830eedb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830eed4 expref: 12 pid: 6513 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120731.471061:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009de1df45 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970503040:0@lo:104: 00000100:00100000:3.0:1789120731.471151:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120731.471217:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set 00000000860320d8 going to sleep for 11 seconds 00000100:00100000:0.0:1789120731.471302:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970503040 00000100:00100000:0.0:1789120731.471313:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970503040 00000100:00100000:0.0:1789120731.471374:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120731.471384:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097a48892 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:6534:x1876028970503040:12345-0@lo:104: 00010000:00010000:0.0:1789120731.471407:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.471472:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120731.471484:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097a48892 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:6534:x1876028970503040:12345-0@lo:104: Request processed in 101us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120731.471493:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120731.471545:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009de1df45 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970503040:0@lo:104: 00010000:00010000:0.0:1789120731.471570:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.471590:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120731.471596:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.471603:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007211b1aa already unused, calling callback (000000007f6132ca) 10000000:00010000:0.0:1789120731.471606:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.471613:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120731.471620:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120731.471627:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120731.471662:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.471670:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120731.471703:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.471709:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830eed4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830eedb expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.471734:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120731.471737:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120731.471739:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120731.471859:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120731.471872:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001aa2478d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970503168:0@lo:103: 00000100:00100000:0.0:1789120731.471909:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120731.471951:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970503168 00000100:00100000:0.0:1789120731.471955:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970503168 00010000:00010000:0.0:1789120731.471973:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f6407ee2/0xb74d2367a830eedb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830eed4 expref: 13 pid: 6513 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120731.471997:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120731.472002:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8844622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+13:3644:x1876028970503168:12345-0@lo:103: 00010000:00010000:0.0:1789120731.472014:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120731.472019:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f6407ee2/0xb74d2367a830eedb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830eed4 expref: 13 pid: 6513 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472028:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f6407ee2/0xb74d2367a830eedb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830eed4 expref: 13 pid: 6513 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472042:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f6407ee2/0xb74d2367a830eedb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830eed4 expref: 13 pid: 6513 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472055:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472063:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789120731.472093:0:6503:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001175279s 00010000:00010000:0.0:1789120731.472097:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472103:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472109:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472114:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472118:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008b93fba5 already unused, calling callback (0000000026fe3ef7) 00010000:00010000:0.0:1789120731.472122:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472129:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472141:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472151:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120731.472180:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8844622 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+12:3644:x1876028970503168:12345-0@lo:103: Request processed in 178us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120731.472187:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789120731.472211:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472227:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120731.472232:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008b93fba5/0xb74d2367a830ef0c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120731.472273:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001aa2478d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970503168:0@lo:103: 00000100:00100000:0.0:1789120731.472661:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d677063e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+11:6495:x1876028970502912:12345-0@lo:253: Request processed in 13294us (13668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120731.472671:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789120731.473555:0:6495:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000035ffc68 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:6495:1876028970502912:0@lo:253: 10000000:01000000:1.0:1789120731.473572:0:6495:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789120731.473575:0:6495:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789120731.473577:0:6495:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789120731.473579:0:6495:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789120731.473580:0:6495:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789120731.473581:0:6495:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789120731.473583:0:6495:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789120731.473584:0:6495:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789120731.473586:0:6495:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789120731.473587:0:6495:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789120731.473589:0:6495:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789120731.473591:0:6495:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789120731.473592:0:6495:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789120731.473618:0:6495:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789120731.483050:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:0.0:1789120731.483210:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1789120731.483468:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:0.0:1789120731.483599:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1789120731.483763:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:0.0:1789120731.483921:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1789120731.486213:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:1.0:1789120731.486542:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1789120731.486742:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:1.0:1789120731.487523:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1789120731.487749:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:1.0:1789120731.488147:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1789120731.497268:0:6495:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1789120731.510693:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789120731.510876:0:6550:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1789120731.510881:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789120731.511508:0:6551:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789120731.517332:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789120731.517466:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789120731.517918:0:6495:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789120731.517926:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789120731.518034:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120731.519036:0:6495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789120731.520898:0:6551:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120731.528191:0:6495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789120731.528338:0:6495:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1789120731.529070:0:6495:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789120731.529368:0:6495:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00000040:00080000:0.0:1789120731.529952:0:6551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789120731.530069:0:6551:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789120731.530074:0:6551:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:3.0:1789120731.533635:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1789120731.534120:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1789120731.534308:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1789120731.534530:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1789120731.535083:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1789120731.535227:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1789120731.535473:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1789120731.535630:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1789120731.536021:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1789120731.536159:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1789120731.536337:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1789120731.536564:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1789120731.536740:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1789120731.537233:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1789120731.537483:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1789120731.537636:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1789120731.539250:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1789120731.539481:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1789120731.539605:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1789120731.539726:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1789120731.539899:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1789120731.540050:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1789120731.540193:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1789120731.540366:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1789120731.540501:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1789120731.540667:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1789120731.540810:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1789120731.540973:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1789120731.541099:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1789120731.541262:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1789120731.541396:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1789120731.541529:0:6495:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1789120731.541757:0:6495:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1789120731.549327:0:6495:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1789120731.549372:0:6495:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa04ac1c3f988 00100000:10000000:0.0:1789120731.549382:0:6495:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789120731.550293:0:6495:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789120731.550319:0:6495:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789120731.550352:0:6495:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789120731.550380:0:6495:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789120731.551558:0:6495:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789120731.551797:0:6495:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:1.0:1789120731.799000:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120732.824269:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120733.842212:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120734.871771:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120735.890159:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789120736.662066:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789120736.662074:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946886899000 from 3 10000000:01000000:1.0:1789120736.662079:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789120736.662136:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120736.662151:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120736.662161:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120736.662184:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d01660c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970503296:0@lo:101: 00000100:00100000:1.0:1789120736.662291:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120736.662532:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e57a0ca going to sleep for 11 seconds 00000100:00080000:2.0:1789120736.662901:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789120736.662908:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789120736.662911:0:36:0:(import.c:65:import_set_state_nolock()) 0000000056d2a703 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789120736.662920:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000056d2a703 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789120736.662960:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000037bc4200 x1876028970503424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789120736.663126:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037bc4200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970503424:0@lo:38: 00000100:00100000:1.0:1789120736.663169:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120736.663413:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970503424 00000100:00100000:2.0:1789120736.663427:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970503424 00000100:00100000:2.0:1789120736.663477:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120736.663483:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009fd8fe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876028970503424:12345-0@lo:38: 00010000:00080000:2.0:1789120736.663507:0:6520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:2.0:1789120736.663545:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb74d2367a830ef1a 00000004:00100000:2.0:1789120736.663591:0:6520:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789120736.663713:0:6520:0:(import.c:65:import_set_state_nolock()) 00000000a7d957d0 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789120736.663766:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009fd8fe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876028970503424:12345-0@lo:38: Request processed in 282us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120736.663774:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789120736.667637:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000037bc4200 x1876028970503424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120746 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789120736.667664:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789120736.667675:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789120736.667680:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789120736.667684:0:3643:0:(import.c:65:import_set_state_nolock()) 0000000056d2a703 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789120736.667692:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037bc4200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970503424:0@lo:38: 00000100:00100000:0.0:1789120736.670879:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970503296 00000100:00100000:0.0:1789120736.670897:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970503296 00000100:00100000:3.0:1789120736.674700:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789120736.674715:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009987d3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+11:6515:x1876028970503296:12345-0@lo:101: 00010000:00010000:3.0:1789120736.674737:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120736.674760:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e4eab6c5/0xb74d2367a830ef21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830ef13 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120736.674790:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e4eab6c5/0xb74d2367a830ef21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830ef13 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120736.674800:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e4eab6c5/0xb74d2367a830ef21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ef13 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120736.674809:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e4eab6c5, rc 0) 00000100:00100000:3.0:1789120736.674909:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009987d3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+12:6515:x1876028970503296:12345-0@lo:101: Request processed in 198us (12619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120736.674917:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789120736.676918:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d01660c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970503296:0@lo:101: 00010000:00010000:1.0:1789120736.676959:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120736.676972:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120736.677042:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d01660c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970503552:0@lo:256: 00000100:00100000:1.0:1789120736.677119:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120736.677157:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000001e57a0ca going to sleep for 11 seconds 00000100:00100000:1.0:1789120736.677177:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970503552 00000100:00100000:1.0:1789120736.677183:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970503552 00000100:00100000:1.0:1789120736.677556:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789120736.677566:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f1957a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+12:6515:x1876028970503552:12345-0@lo:256: 20000000:01000000:1.0:1789120736.677587:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789120736.677603:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789120736.677606:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1789120736.677694:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f1957a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+12:6515:x1876028970503552:12345-0@lo:256: Request processed in 130us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120736.677702:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789120736.677747:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d01660c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970503552:0@lo:256: 10000000:01000000:1.0:1789120736.677791:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789120736.677797:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120736.677805:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120736.915045:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789120737.124241:0:6796:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789120737.942808:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789120738.150594:0:6848:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789120738.151353:0:6848:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789120738.966893:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120739.986059:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120741.010017:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789120741.541939:0:6950:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789120741.542093:0:6950:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789120741.781399:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4a38d17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970503808:0@lo:400: 00000100:00100000:0.0:1789120741.781621:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120741.781684:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120741.781691:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d01660c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970503680:0@lo:400: 00000100:00100000:0.0:1789120741.781721:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120741.782339:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970503808 00000100:00100000:1.0:1789120741.782350:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970503808 00000100:00100000:1.0:1789120741.782427:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120741.782437:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1017943 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970503808:12345-0@lo:400: 00000100:00100000:1.0:1789120741.782515:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1017943 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970503808:12345-0@lo:400: Request processed in 80us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120741.782522:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120741.782546:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970503680 00000100:00100000:1.0:1789120741.782550:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970503680 00000100:00100000:1.0:1789120741.782575:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789120741.782581:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000007c4add9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:3647:x1876028970503680:12345-0@lo:400: 00000100:00100000:1.0:1789120741.782611:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000007c4add9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:3647:x1876028970503680:12345-0@lo:400: Request processed in 31us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120741.782617:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789120741.782660:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d01660c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970503680:0@lo:400: 00010000:00080000:1.0:1789120741.782692:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f4a38d17 x1876028970503808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120757 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120741.782705:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4a38d17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970503808:0@lo:400: 00010000:00010000:1.0:1789120742.034982:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120743.058642:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120744.083901:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120745.106199:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120746.131316:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120746.900139:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097829dea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970503936:0@lo:400: 00000100:00100000:1.0:1789120746.900215:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120746.900266:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120746.900272:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006ab8f47b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970504064:0@lo:400: 00000100:00100000:1.0:1789120746.900300:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120746.900334:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970503936 00000100:00100000:1.0:1789120746.900342:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970503936 00000100:00100000:1.0:1789120746.900386:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789120746.900394:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000970f3df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+12:3644:x1876028970503936:12345-0@lo:400: 00000100:00100000:1.0:1789120746.900441:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000970f3df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+12:3644:x1876028970503936:12345-0@lo:400: Request processed in 48us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120746.900449:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789120746.900481:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970504064 00000100:00100000:1.0:1789120746.900485:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970504064 00000100:00100000:1.0:1789120746.900509:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789120746.900516:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fef65b25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970504064:12345-0@lo:400: 00000100:00100000:1.0:1789120746.900547:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fef65b25 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970504064:12345-0@lo:400: Request processed in 33us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120746.900553:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789120746.900599:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006ab8f47b x1876028970504064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120762 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120746.900612:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006ab8f47b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970504064:0@lo:400: 00000100:00100000:1.0:1789120746.900621:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097829dea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970503936:0@lo:400: 00010000:00010000:1.0:1789120747.154207:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120748.183483:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120749.211541:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120750.231486:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120751.254565:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120752.019559:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b7f31604 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970504320:0@lo:400: 00000100:00100000:0.0:1789120752.020920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120752.021009:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120752.021018:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a45e847 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970504192:0@lo:400: 00000100:00100000:0.0:1789120752.021077:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120752.021154:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970504192 00000100:00100000:3.0:1789120752.021171:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970504192 00000100:00100000:3.0:1789120752.021262:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789120752.021273:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006dcdb5a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+12:3647:x1876028970504192:12345-0@lo:400: 00000100:00100000:3.0:1789120752.021389:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006dcdb5a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+12:3647:x1876028970504192:12345-0@lo:400: Request processed in 118us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120752.021398:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789120752.021498:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970504320 00000100:00100000:2.0:1789120752.021508:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970504320 00000100:00100000:2.0:1789120752.021569:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789120752.021578:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee845bb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970504320:12345-0@lo:400: 00000100:00100000:2.0:1789120752.021636:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee845bb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970504320:12345-0@lo:400: Request processed in 60us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120752.021642:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120752.023012:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a45e847 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970504192:0@lo:400: 00010000:00080000:0.0:1789120752.023032:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b7f31604 x1876028970504320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120752.023045:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b7f31604 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970504320:0@lo:400: 00010000:00010000:1.0:1789120752.276976:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120753.298517:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120754.322465:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789120754.775532:0:7449:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789120754.775538:0:7449:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789120754.775540:0:7449:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789120754.775711:0:7449:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f84658cb 00000020:01000004:2.0:1789120754.775730:0:7449:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1789120754.775743:0:7449:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789120754.775760:0:7449:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (000000006a19371d) 00000020:00000080:2.0:1789120754.775778:0:7449:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789120754.836221:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:3.0:1789120754.836353:0:7449:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1789120754.853665:0:7449:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789120754.853998:0:7449:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1789120754.854014:0:7449:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789120754.854044:0:7449:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a830ef2f 00000020:01000004:0.0:1789120754.854052:0:7449:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789120754.854082:0:7449:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789120754.854086:0:7449:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789120754.854095:0:7449:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1789120754.854135:0:7449:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1789120754.854140:0:7449:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1789120754.909579:0:7449:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789120754.909628:0:7449:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.132@tcp, index=0001, flags=0x20061 00000020:01000004:0.0:1789120754.909632:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789120754.909634:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789120754.909635:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120754.909636:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120754.909637:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120754.909639:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120754.909640:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120754.909641:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789120754.909642:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789120754.909644:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120754.909645:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789120754.909648:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:0.0:1789120754.909651:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789120754.909652:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789120754.909653:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789120754.909654:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789120754.909655:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789120754.909656:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789120754.909657:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789120754.909658:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789120754.909659:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789120754.909660:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789120754.909661:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789120754.909691:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789120754.909710:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a31a2169 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970504448:0@lo:253: 00000100:00100000:0.0:1789120754.909791:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120754.909878:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000849c304d going to sleep for 11 seconds 00000100:00100000:1.0:1789120754.909954:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970504448 00000100:00100000:1.0:1789120754.909963:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970504448 00000100:00100000:1.0:1789120754.910030:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789120754.910039:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0769e78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970504448:12345-0@lo:253: 20000000:01000000:1.0:1789120754.910074:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789120754.910079:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1789120754.910084:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1789120754.910088:0:6513:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1789120754.910127:0:6513:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1789120754.910434:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789120754.910563:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1789120754.910576:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789120754.910593:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1789120754.910607:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1789120754.910620:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1789120754.910671:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1789120754.910679:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1789120754.910691:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1789120754.910696:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1789120754.910705:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1789120754.910717:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1789120754.910730:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1789120754.910743:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:2.0:1789120754.913556:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:2.0:1789120754.913582:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:2.0:1789120754.913598:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:2.0:1789120754.913617:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789120754.913634:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:2.0:1789120754.913641:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:2.0:1789120754.913652:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:2.0:1789120754.913657:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1789120754.913669:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:2.0:1789120754.913682:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:2.0:1789120754.913693:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:2.0:1789120754.913863:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:2.0:1789120754.913874:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:2.0:1789120754.913888:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:2.0:1789120754.913908:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:2.0:1789120754.913928:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:2.0:1789120754.913936:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:2.0:1789120754.913951:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:2.0:1789120754.913984:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:2.0:1789120754.913990:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:2.0:1789120754.914012:0:6513:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1789120754.914018:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:2.0:1789120754.917482:0:7455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:1.0:1789120754.922924:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1789120754.922956:0:6513:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.132@tcp for mdt 20000000:01000000:1.0:1789120754.922960:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:1.0:1789120754.922977:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1789120754.922982:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789120754.922993:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1789120754.922997:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:1.0:1789120754.923011:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1789120754.923018:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:1.0:1789120754.923042:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:1.0:1789120754.923056:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:1.0:1789120754.923104:0:6513:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:1.0:1789120754.923113:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:3.0:1789120754.923472:0:7456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:1.0:1789120754.923638:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1789120754.923650:0:6513:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.202.132@tcp for mdt 20000000:01000000:1.0:1789120754.923652:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:1.0:1789120754.923663:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1789120754.923667:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1789120754.923677:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1789120754.923681:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:1.0:1789120754.923691:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1789120754.923696:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:1.0:1789120754.923705:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1789120754.923717:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:1.0:1789120754.923735:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789120754.923738:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789120754.923742:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789120754.923804:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789120754.923806:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789120754.924625:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1789120754.924653:0:7457:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1789120754.924664:0:7457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1789120754.924803:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:1.0:1789120754.924851:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:1.0:1789120754.924868:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:1.0:1789120754.924878:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789120754.924879:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789120754.925258:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789120754.925454:0:7458:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789120754.925470:0:7458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:1.0:1789120754.925607:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:1.0:1789120754.925627:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:1.0:1789120754.925645:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:1.0:1789120754.925653:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789120754.925654:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789120754.926018:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1789120754.926051:0:7459:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1789120754.926064:0:7459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1789120754.926188:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1789120754.926205:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1789120754.926226:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1789120754.926239:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789120754.926241:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789120754.926247:0:6513:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789120754.926252:0:6513:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789120754.926643:0:7460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:1.0:1789120754.926739:0:6513:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789120754.934013:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789120754.934064:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.934093:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000575abd1/0xb74d2367a830ee6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ee64 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.934100:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009fb4546b/0xb74d2367a830ee87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ee80 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.934105:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000038c5adaf/0xb74d2367a830eef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830eef0 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.934131:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.934253:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000038c5adaf/0xb74d2367a830eef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830eef0 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.934272:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000038c5adaf/0xb74d2367a830eef7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830eef0 expref: 12 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120754.934298:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097829dea pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970504576:0@lo:104: 00000100:00100000:1.0:1789120754.934384:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120754.934442:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970504576 00000100:00100000:3.0:1789120754.934456:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970504576 00010000:00010000:1.0:1789120754.934463:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009fb4546b/0xb74d2367a830ee87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830ee80 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.934474:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009fb4546b/0xb74d2367a830ee87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830ee80 expref: 12 pid: 6513 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120754.934484:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a76e52e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970504704:0@lo:104: 00000100:00100000:3.0:1789120754.934526:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120754.934537:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ab8f47b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:6513:x1876028970504576:12345-0@lo:104: 00010000:00010000:3.0:1789120754.934556:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.934645:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120754.934650:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ab8f47b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:6513:x1876028970504576:12345-0@lo:104: Request processed in 116us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120754.934657:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1789120754.934677:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120754.934686:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.934695:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000db1dd193 already unused, calling callback (000000007f6132ca) 10000000:00010000:0.0:1789120754.934698:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.934723:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120754.934730:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120754.934737:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120754.934787:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.934794:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120754.934855:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.934863:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: 00000000db1dd193/0xb74d2367a830eef0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830eef7 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.934883:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120754.934885:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120754.934887:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120754.934902:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bef918e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970504832:0@lo:103: 00000100:00100000:2.0:1789120754.934949:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120754.935070:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970504832 00000100:00100000:0.0:1789120754.935078:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970504832 00010000:00010000:0.0:1789120754.935110:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000038c5adaf/0xb74d2367a830eef7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830eef0 expref: 13 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120754.935150:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789120754.935160:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000545c8ddc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+13:3644:x1876028970504832:12345-0@lo:103: 00010000:00010000:0.0:1789120754.935241:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120754.935247:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000038c5adaf/0xb74d2367a830eef7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830eef0 expref: 13 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.935266:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000038c5adaf/0xb74d2367a830eef7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830eef0 expref: 13 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.935287:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120754.935339:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000545c8ddc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+13:3644:x1876028970504832:12345-0@lo:103: Request processed in 182us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120754.935346:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120754.935408:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bef918e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970504832:0@lo:103: 00000100:00100000:1.0:1789120754.935421:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120754.935504:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000575abd1/0xb74d2367a830ee6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830ee64 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.935514:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000575abd1/0xb74d2367a830ee6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830ee64 expref: 12 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120754.935524:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970504960:0@lo:104: 00000100:00100000:1.0:1789120754.935555:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120754.935658:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b418606 going to sleep for 11 seconds 00010000:00010000:1.0:1789120754.935679:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038c5adaf/0xb74d2367a830eef7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830eef0 expref: 12 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120754.935705:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097829dea pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970504576:0@lo:104: 00000100:00100000:0.0:1789120754.935746:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970504704 00000100:00100000:0.0:1789120754.935750:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970504704 00000100:00100000:0.0:1789120754.935774:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970504960 00000100:00100000:0.0:1789120754.935777:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970504960 00000100:00100000:0.0:1789120754.935791:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120754.935797:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6124108 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:6513:x1876028970504704:12345-0@lo:104: 00010000:00010000:0.0:1789120754.935807:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.936117:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789120754.936123:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6124108 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:6513:x1876028970504704:12345-0@lo:104: Request processed in 326us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120754.936134:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789120754.936149:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789120754.936155:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d01660c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:6513:x1876028970504960:12345-0@lo:104: 00010000:00010000:1.0:1789120754.936162:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.936212:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789120754.936217:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d01660c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:6513:x1876028970504960:12345-0@lo:104: Request processed in 64us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120754.936223:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789120754.936318:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a76e52e pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970504704:0@lo:104: 00010000:00010000:0.0:1789120754.936328:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789120754.936332:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.936339:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ffefcaf6 already unused, calling callback (000000007f6132ca) 10000000:00010000:0.0:1789120754.936342:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.936350:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120754.936370:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120754.936375:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120754.936446:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.936454:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120754.936472:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.936479:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: 00000000ffefcaf6/0xb74d2367a830ee80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ee87 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.936491:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120754.936493:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.936499:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7b1e74e already unused, calling callback (000000007f6132ca) 10000000:00010000:0.0:1789120754.936501:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.936507:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120754.936513:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120754.936518:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789120754.936542:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120754.936568:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001440a535 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970505088:0@lo:103: 00010000:00010000:0.0:1789120754.936616:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.936624:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789120754.936631:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120754.936652:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.936660:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830ee64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ee6b expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.936678:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120754.936682:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120754.936684:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120754.936698:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098a9cb09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970505216:0@lo:103: 00000100:00100000:3.0:1789120754.936700:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970505088 00000100:00100000:3.0:1789120754.936709:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970505088 00010000:00010000:3.0:1789120754.936741:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009fb4546b/0xb74d2367a830ee87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830ee80 expref: 12 pid: 6513 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120754.936755:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120754.936791:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970505216 00000100:00100000:3.0:1789120754.936795:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970505216 00010000:00010000:3.0:1789120754.936805:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000575abd1/0xb74d2367a830ee6b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830ee64 expref: 13 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120754.936849:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120754.936856:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de144bef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+13:3645:x1876028970505088:12345-0@lo:103: 00010000:00010000:3.0:1789120754.936870:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120754.936875:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009fb4546b/0xb74d2367a830ee87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830ee80 expref: 13 pid: 6513 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.936889:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009fb4546b/0xb74d2367a830ee87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830ee80 expref: 13 pid: 6513 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.936906:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009fb4546b/0xb74d2367a830ee87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830ee80 expref: 13 pid: 6513 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.936920:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120754.936947:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970504960:0@lo:104: 00010000:00010000:0.0:1789120754.936977:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120754.937144:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de144bef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+12:3645:x1876028970505088:12345-0@lo:103: Request processed in 288us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120754.937152:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120754.937170:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001440a535 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970505088:0@lo:103: 00000100:00100000:3.0:1789120754.937173:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789120754.937185:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000486376fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+11:3646:x1876028970505216:12345-0@lo:103: 00010000:00010000:3.0:1789120754.937193:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120754.937197:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000575abd1/0xb74d2367a830ee6b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830ee64 expref: 11 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937206:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000575abd1/0xb74d2367a830ee6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830ee64 expref: 11 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937215:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000575abd1/0xb74d2367a830ee6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830ee64 expref: 11 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937235:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937242:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937255:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937261:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937281:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937287:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937293:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004ad6923a already unused, calling callback (0000000026fe3ef7) 00010000:00010000:3.0:1789120754.937296:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937303:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937315:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.937324:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120754.937324:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.937333:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.937340:0:6513:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004ad6923a/0xb74d2367a830ef36 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120754.937360:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000486376fd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+10:3646:x1876028970505216:12345-0@lo:103: Request processed in 177us (614us total) trans 0 rc 0/0 20000000:01000000:0.0:1789120754.937360:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789120754.937379:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789120754.937392:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098a9cb09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970505216:0@lo:103: 00000100:00100000:0.0:1789120754.939699:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0769e78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+9:7449:x1876028970504448:12345-0@lo:253: Request processed in 29654us (29902us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120754.939716:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789120754.939745:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a31a2169 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970504448:0@lo:253: 10000000:01000000:1.0:1789120754.939769:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1789120754.939772:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789120754.939774:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789120754.939776:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789120754.939777:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:1.0:1789120754.939778:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789120754.939780:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789120754.939781:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789120754.939782:0:7449:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789120754.939784:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789120754.939785:0:7449:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789120754.939808:0:7449:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f84658cb from lustre-MDT0001 10000000:01000000:1.0:1789120754.939895:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1789120754.939898:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789120754.939907:0:7449:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9468ab900000 local copy 10000000:01000000:1.0:1789120754.939912:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789120754.939957:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.940084:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.940094:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120754.940115:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970505344:0@lo:101: 00000100:00100000:1.0:1789120754.940188:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120754.940241:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970505344 00000100:00100000:1.0:1789120754.940243:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b418606 going to sleep for 11 seconds 00000100:00100000:0.0:1789120754.940251:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970505344 00000100:00100000:0.0:1789120754.940299:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789120754.940306:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040fcec00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+9:7449:x1876028970505344:12345-0@lo:101: 00010000:00010000:0.0:1789120754.940320:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120754.940346:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000247e58ce/0xb74d2367a830ef44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830ef3d expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.940379:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000247e58ce/0xb74d2367a830ef44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830ef3d expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.940390:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000247e58ce/0xb74d2367a830ef44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ef3d expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.940398:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000247e58ce, rc 0) 00000100:00100000:0.0:1789120754.940445:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040fcec00 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+10:7449:x1876028970505344:12345-0@lo:101: Request processed in 139us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120754.940451:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789120754.940482:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970505344:0@lo:101: 00010000:00010000:1.0:1789120754.940500:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.940510:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120754.940645:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970505472:0@lo:501: 00000100:00100000:1.0:1789120754.940678:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120754.940697:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000004b418606 going to sleep for 11 seconds 00000100:00100000:0.0:1789120754.940717:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970505472 00000100:00100000:0.0:1789120754.940724:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970505472 00000100:00100000:0.0:1789120754.940761:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789120754.940768:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abb1b393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+10:7449:x1876028970505472:12345-0@lo:501: 00000100:00100000:0.0:1789120754.940874:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abb1b393 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+10:7449:x1876028970505472:12345-0@lo:501: Request processed in 107us (195us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120754.940883:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789120754.940914:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970505472:0@lo:501: 10000000:01000000:1.0:1789120754.940929:0:7449:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789120754.940950:0:7449:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789120754.940960:0:7449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.941046:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.941054:0:7449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.941077:0:7449:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789120754.941109:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946883582800 10000000:01000000:1.0:1789120754.941114:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789120754.941120:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9468ab900000 10000000:01000000:1.0:1789120754.941122:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789120754.941126:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9468ab900000 from 1 10000000:01000000:1.0:1789120754.941129:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789120754.941147:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 0000000023b8d617/0xb74d2367a830ef4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.941154:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 0000000023b8d617/0xb74d2367a830ef4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.941161:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 0000000023b8d617/0xb74d2367a830ef4b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120754.941184:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970505600:0@lo:101: 00000100:00100000:1.0:1789120754.941217:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120754.941236:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c39f1c6 going to sleep for 11 seconds 00000100:00100000:0.0:1789120754.941255:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970505600 00000100:00100000:0.0:1789120754.941274:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970505600 00010000:00010000:3.0:1789120754.941281:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120754.941289:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.941296:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007211b1aa already unused, calling callback (000000007f6132ca) 10000000:00010000:3.0:1789120754.941300:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.941306:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120754.941313:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120754.941319:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 10000000:01000000:3.0:1789120754.941328:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789120754.941346:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.941350:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120754.941371:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.941376:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: 000000007211b1aa/0xb74d2367a830ef3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb74d2367a830ef44 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.941391:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120754.941392:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120754.941393:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120754.941401:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120754.941415:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cfcad1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970505728:0@lo:103: 00000100:00100000:0.0:1789120754.941431:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048d95266 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+10:7449:x1876028970505600:12345-0@lo:101: 00010000:00010000:0.0:1789120754.941441:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120754.941455:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001c597ffc/0xb74d2367a830ef52 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830ef4b expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120754.941462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120754.941485:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001c597ffc/0xb74d2367a830ef52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830ef4b expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.941494:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001c597ffc/0xb74d2367a830ef52 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ef4b expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120754.941495:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970505728 00000100:00100000:3.0:1789120754.941501:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970505728 00010000:00010000:0.0:1789120754.941512:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001c597ffc, rc 0) 00000100:00100000:3.0:1789120754.941546:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789120754.941553:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0901ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+12:3646:x1876028970505728:12345-0@lo:103: 00010000:00010000:3.0:1789120754.941566:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789120754.941569:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048d95266 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970505600:12345-0@lo:101: Request processed in 141us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120754.941579:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789120754.941588:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000247e58ce/0xb74d2367a830ef44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830ef3d expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.941608:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120754.941657:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0901ba7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+10:3646:x1876028970505728:12345-0@lo:103: Request processed in 104us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120754.941665:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120754.941708:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cfcad1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970505728:0@lo:103: 00000100:00100000:1.0:1789120754.941767:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970505600:0@lo:101: 00010000:00010000:1.0:1789120754.941782:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 0000000023b8d617/0xb74d2367a830ef4b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef52 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.941797:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 0000000023b8d617/0xb74d2367a830ef4b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830ef52 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120754.941816:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789120754.941859:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 0000000023b8d617/0xb74d2367a830ef4b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef52 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.941867:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 0000000023b8d617/0xb74d2367a830ef4b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef52 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120754.941876:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff946883582800 10000000:01000000:1.0:1789120754.941880:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1789120754.941884:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff946883582800 from 1 10000000:01000000:1.0:1789120754.941887:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1789120754.941902:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000e615ab3a/0xb74d2367a830ef59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.941909:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000e615ab3a/0xb74d2367a830ef59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.941916:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000e615ab3a/0xb74d2367a830ef59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120754.941929:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970505856:0@lo:101: 00000100:00100000:1.0:1789120754.941956:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120754.942369:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c39f1c6 going to sleep for 11 seconds 00000100:00100000:0.0:1789120754.942436:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970505856 00000100:00100000:0.0:1789120754.942443:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970505856 00000100:00100000:0.0:1789120754.942480:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789120754.942486:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000128eecfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+10:7449:x1876028970505856:12345-0@lo:101: 00010000:00010000:0.0:1789120754.942496:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120754.942506:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000001e526e6/0xb74d2367a830ef60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830ef59 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.942523:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000001e526e6/0xb74d2367a830ef60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830ef59 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.942545:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000001e526e6/0xb74d2367a830ef60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ef59 expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120754.942552:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000001e526e6, rc 0) 00000100:00100000:0.0:1789120754.942595:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000128eecfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+11:7449:x1876028970505856:12345-0@lo:101: Request processed in 109us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120754.942603:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789120754.942622:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970505856:0@lo:101: 00010000:00010000:1.0:1789120754.942641:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000e615ab3a/0xb74d2367a830ef59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.942658:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000e615ab3a/0xb74d2367a830ef59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120754.942671:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1789120754.942686:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000e615ab3a/0xb74d2367a830ef59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.942692:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000e615ab3a/0xb74d2367a830ef59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120754.942699:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1789120754.942703:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789120754.942708:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff946883582800 10000000:01000000:1.0:1789120754.942710:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1789120754.942714:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:1.0:1789120754.942716:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789120754.942735:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 0000000017ec46a9/0xb74d2367a830ef67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.942741:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 0000000017ec46a9/0xb74d2367a830ef67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.942748:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 0000000017ec46a9/0xb74d2367a830ef67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120754.942761:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970505984:0@lo:101: 00000100:00100000:1.0:1789120754.942796:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120754.942887:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c39f1c6 going to sleep for 11 seconds 00000100:00100000:3.0:1789120754.942934:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970505984 00000100:00100000:3.0:1789120754.942940:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970505984 00000100:00100000:3.0:1789120754.943072:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789120754.943081:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d49f3f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+11:7449:x1876028970505984:12345-0@lo:101: 00010000:00010000:3.0:1789120754.943093:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120754.943106:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000363f932f/0xb74d2367a830ef6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830ef67 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.943124:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000363f932f/0xb74d2367a830ef6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830ef67 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.943133:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000363f932f/0xb74d2367a830ef6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ef67 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120754.943141:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000363f932f, rc 0) 00000100:00100000:3.0:1789120754.943298:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d49f3f3c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970505984:12345-0@lo:101: Request processed in 218us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120754.943304:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789120754.943356:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970505984:0@lo:101: 00010000:00010000:1.0:1789120754.943367:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 0000000017ec46a9/0xb74d2367a830ef67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120754.943374:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 0000000017ec46a9/0xb74d2367a830ef67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120754.943476:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970506112:0@lo:501: 00000100:00100000:1.0:1789120754.943505:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120754.943530:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c39f1c6 going to sleep for 11 seconds 00000100:00100000:0.0:1789120754.943586:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970506112 00000100:00100000:0.0:1789120754.943590:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970506112 00000100:00100000:0.0:1789120754.943648:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789120754.943654:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013d03857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970506112:12345-0@lo:501: 00000100:00100000:0.0:1789120754.943785:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013d03857 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970506112:12345-0@lo:501: Request processed in 132us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120754.943790:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789120754.943847:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970506112:0@lo:501: 00000100:00100000:3.0:1789120754.943869:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053cdb499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970506240:0@lo:503: 00000100:00100000:3.0:1789120754.943900:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120754.944055:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970506240 00000100:00100000:1.0:1789120754.944059:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970506240 00000100:00100000:1.0:1789120754.944081:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789120754.944088:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008294b78c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970506240:12345-0@lo:503: 00000100:00100000:1.0:1789120754.944158:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008294b78c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970506240:12345-0@lo:503: Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120754.944166:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789120754.944308:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000081ddcacd going to sleep for 11 seconds 00000100:00100000:3.0:1789120754.944322:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053cdb499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970506240:0@lo:503: 00000040:00080000:3.0:1789120754.944610:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120754.944689:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053cdb499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970506368:0@lo:502: 00000100:00100000:3.0:1789120754.944724:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120754.944773:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000865b5489 going to sleep for 11 seconds 00000100:00100000:1.0:1789120754.944800:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970506368 00000100:00100000:1.0:1789120754.944803:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970506368 00000100:00100000:1.0:1789120754.944886:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789120754.944892:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000000553d02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970506368:12345-0@lo:502: 00000100:00100000:1.0:1789120754.944952:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000000553d02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970506368:12345-0@lo:502: Request processed in 61us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120754.944957:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789120754.945041:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053cdb499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970506368:0@lo:502: 00000040:00080000:3.0:1789120754.945296:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789120754.945315:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:3.0:1789120754.945322:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:3.0:1789120754.945329:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:3.0:1789120754.945336:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:3.0:1789120754.945344:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:3.0:1789120754.945350:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:3.0:1789120754.945356:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:3.0:1789120754.945363:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:3.0:1789120754.945369:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:3.0:1789120754.945376:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:3.0:1789120754.945383:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:3.0:1789120754.945390:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:3.0:1789120754.945396:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:3.0:1789120754.945403:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:3.0:1789120754.945420:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:3.0:1789120754.945428:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:3.0:1789120754.945437:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:3.0:1789120754.945446:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:3.0:1789120754.945455:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:3.0:1789120754.945465:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:3.0:1789120754.945480:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:3.0:1789120754.945499:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:3.0:1789120754.945529:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053cdb499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970506496:0@lo:502: 00000100:00100000:3.0:1789120754.945562:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120754.945594:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970506496 00000100:00100000:3.0:1789120754.945597:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000865b5489 going to sleep for 11 seconds 00000100:00100000:0.0:1789120754.945598:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970506496 00000100:00100000:0.0:1789120754.945635:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789120754.945641:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d1e952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970506496:12345-0@lo:502: 00000100:00100000:0.0:1789120754.945896:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d1e952 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970506496:12345-0@lo:502: Request processed in 254us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120754.945907:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053cdb499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970506496:0@lo:502: 00000100:00100000:0.0:1789120754.945908:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000040:00080000:3.0:1789120754.945957:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:3.0:1789120754.946104:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:1.0:1789120754.948661:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120754.948682:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120754.948686:0:7461:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789120754.948693:0:7461:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789120754.948703:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789120754.948729:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (000000005f5ed0ff) 00000020:00000080:1.0:1789120754.948750:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:1.0:1789120754.948754:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789120754.948947:0:7461:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789120754.948955:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a830ef7c 00000020:00000080:1.0:1789120754.949265:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789120754.949270:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120754.949273:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120754.949274:0:7461:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789120754.949276:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120754.949279:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120754.949280:0:7461:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789120754.949282:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789120754.949288:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000c2f6084d) 00000020:00000080:1.0:1789120754.949295:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:1.0:1789120754.949298:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789120754.949299:0:7461:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789120754.949302:0:7461:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789120754.949307:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789120754.949715:0:7461:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f84658cb from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789120754.949746:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000018853723) 00000020:00000080:1.0:1789120754.949762:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:1.0:1789120754.949879:0:7461:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789120754.949887:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a830ef91 00000020:00000080:1.0:1789120754.950035:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789120754.950043:0:7461:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789120754.950048:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb74d2367a830ef98 00080000:01000000:1.0:1789120754.950054:0:7461:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789120754.950057:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a830ef9f 00080000:10000000:3.0:1789120754.956986:0:7461:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1789120754.957210:0:7461:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1789120755.069772:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1789120755.076490:0:7461:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1789120755.086812:0:7461:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1789120755.092692:0:7461:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789120755.106947:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789120755.106970:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120755.107459:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120755.107464:0:7461:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789120755.107470:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120755.107480:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120755.107481:0:7461:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789120755.107485:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789120755.107979:0:7461:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:00000080:0.0:1789120755.108034:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789120755.108055:0:7461:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (0000000052423ff1) 00000020:00000080:0.0:1789120755.108085:0:7461:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789120755.108093:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789120755.108425:0:7461:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789120755.108435:0:7461:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789120755.108444:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a830efad 00010000:00080000:0.0:1789120755.108486:0:7461:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000b43a6f1e@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789120755.120633:0:7461:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1789120755.131256:0:7461:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789120755.131281:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789120755.131355:0:7461:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789120755.131388:0:7461:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a830efb4 00000100:00080000:1.0:1789120755.131403:0:7461:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789120755.133165:0:7461:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 00000000b43a6f1e using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789120755.133235:0:7461:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f4a38d17 x1876028970506624/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789120755.133275:0:7461:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789120755.133375:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120755.133382:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120755.133384:0:7461:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789120755.133387:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789120755.133391:0:7461:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789120755.133393:0:7461:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789120755.133394:0:7461:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789120755.133396:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789120755.133398:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120755.133400:0:7461:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789120755.133402:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00100000:2.0:1789120755.133591:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f4a38d17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970506624:0@lo:38: 00000100:00100000:2.0:1789120755.133738:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120755.134297:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970506624 00000100:00100000:0.0:1789120755.134315:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970506624 00000100:00100000:0.0:1789120755.134360:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120755.134367:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000054fa504a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876028970506624:12345-0@lo:38: 00010000:00080000:0.0:1789120755.134396:0:6523:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:0.0:1789120755.134434:0:6523:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a830efbb 00000004:00100000:0.0:1789120755.134460:0:6523:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789120755.134466:0:6523:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789120755.134539:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120755.134553:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001440a535 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970506752:0@lo:400: 00000100:00100000:0.0:1789120755.134616:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120755.134678:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970506752 00000100:00100000:0.0:1789120755.134682:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970506752 00000100:00100000:0.0:1789120755.134725:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789120755.134732:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001aa2478d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970506752:12345-0@lo:400: 00000100:00100000:0.0:1789120755.134791:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001aa2478d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970506752:12345-0@lo:400: Request processed in 59us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.134800:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:00000080:1.0:1789120755.134902:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00010000:00080000:0.0:1789120755.134906:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001440a535 x1876028970506752/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120771 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:00000080:1.0:1789120755.134909:0:7461:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789120755.134927:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789120755.134933:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001440a535 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970506752:0@lo:400: 00000004:01000000:1.0:1789120755.135013:0:7461:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789120755.135056:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120755.135061:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120755.135062:0:7461:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789120755.135066:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120755.135069:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120755.135071:0:7461:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789120755.135075:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789120755.135077:0:7461:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789120755.135109:0:7461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120755.135113:0:7461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120755.135114:0:7461:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789120755.135129:0:7461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000020:01000000:3.0:1789120755.138504:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:3.0:1789120755.138573:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789120755.138593:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 0000000017ec46a9/0xb74d2367a830ef67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120755.138610:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 0000000017ec46a9/0xb74d2367a830ef67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120755.138622:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946883582800 from 1 10000000:01000000:3.0:1789120755.138625:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789120755.138679:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120755.138686:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120755.138718:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120755.138748:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053cdb499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970506880:0@lo:101: 00000100:00100000:3.0:1789120755.138904:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.139052:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000002152fa2d going to sleep for 11 seconds 00000100:00100000:1.0:1789120755.139920:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970506880 00000100:00100000:1.0:1789120755.139932:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970506880 00000100:00100000:1.0:1789120755.140075:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789120755.140087:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035699f83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+12:7449:x1876028970506880:12345-0@lo:101: 00010000:00010000:1.0:1789120755.140106:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120755.140125:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038c5adaf/0xb74d2367a830efc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830efc2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120755.140158:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038c5adaf/0xb74d2367a830efc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830efc2 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120755.140170:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038c5adaf/0xb74d2367a830efc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830efc2 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120755.140180:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038c5adaf, rc 0) 00000100:00100000:1.0:1789120755.140245:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035699f83 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+13:7449:x1876028970506880:12345-0@lo:101: Request processed in 160us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120755.140252:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789120755.144580:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053cdb499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970506880:0@lo:101: 00010000:00010000:3.0:1789120755.144628:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120755.144643:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120755.148808:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000053cdb499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507008:0@lo:256: 00000100:00100000:3.0:1789120755.148928:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.148966:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 000000002152fa2d going to sleep for 11 seconds 00000100:00080000:2.0:1789120755.149572:0:6523:0:(import.c:65:import_set_state_nolock()) 000000004d5f939e : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789120755.149656:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000054fa504a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876028970506624:12345-0@lo:38: Request processed in 15288us (15919us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120755.149675:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120755.149682:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970507008 00000100:00100000:1.0:1789120755.149692:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970507008 00000100:00100000:3.0:1789120755.149782:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789120755.149792:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789120755.149799:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789120755.149804:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789120755.149806:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000b43a6f1e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789120755.149838:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f4a38d17 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970506624:0@lo:38: 00000100:00100000:1.0:1789120755.150194:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cb1dddf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970507136:0@lo:41: 00000100:00100000:1.0:1789120755.150229:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120755.150326:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970507136 00000100:00100000:2.0:1789120755.150331:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970507136 00000100:00100000:2.0:1789120755.150382:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120755.150392:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4a38d17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876028970507136:12345-0@lo:41: 00000004:00000024:2.0:1789120755.150426:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789120755.150479:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4a38d17 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3645:x1876028970507136:12345-0@lo:41: Request processed in 89us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120755.150486:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789120755.150525:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cb1dddf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970507136:0@lo:41: 00000100:00100000:0.0:1789120755.156128:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789120755.156144:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d0202f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+13:7449:x1876028970507008:12345-0@lo:256: 20000000:01000000:0.0:1789120755.156178:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789120755.156201:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789120755.156204:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789120755.156379:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d0202f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+13:7449:x1876028970507008:12345-0@lo:256: Request processed in 238us (7449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.156391:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789120755.156443:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000053cdb499 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507008:0@lo:256: 10000000:01000000:0.0:1789120755.158733:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789120755.158764:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.158776:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120755.158785:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946883582800 from 1 10000000:01000000:0.0:1789120755.158788:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120755.158869:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.158878:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.158888:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120755.158926:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001440a535 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507264:0@lo:101: 00000100:00100000:0.0:1789120755.158986:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120755.159047:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ade74f3f going to sleep for 11 seconds 00000100:00100000:3.0:1789120755.159089:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970507264 00000100:00100000:3.0:1789120755.159102:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970507264 00000100:00100000:0.0:1789120755.159271:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789120755.159282:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037ad6192 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+13:7449:x1876028970507264:12345-0@lo:101: 00010000:00010000:0.0:1789120755.159303:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120755.159323:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000aeacd32/0xb74d2367a830efd7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830efd0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.159354:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000aeacd32/0xb74d2367a830efd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830efd0 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.159368:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000aeacd32/0xb74d2367a830efd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830efd0 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.159378:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000aeacd32, rc 0) 00000100:00100000:0.0:1789120755.159480:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037ad6192 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+14:7449:x1876028970507264:12345-0@lo:101: Request processed in 199us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.159492:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789120755.159649:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001440a535 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507264:0@lo:101: 00010000:00010000:1.0:1789120755.159668:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120755.159677:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120755.159806:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507392:0@lo:501: 00000100:00100000:1.0:1789120755.159939:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120755.159969:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058c4e1e8 going to sleep for 11 seconds 00000100:00100000:3.0:1789120755.160338:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970507392 00000100:00100000:3.0:1789120755.160345:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970507392 00000100:00100000:3.0:1789120755.160382:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789120755.160388:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ca97f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+14:7449:x1876028970507392:12345-0@lo:501: 00000100:00100000:3.0:1789120755.160530:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ca97f4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+14:7449:x1876028970507392:12345-0@lo:501: Request processed in 143us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120755.160535:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789120755.160620:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000063519218 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507392:0@lo:501: 00000100:00100000:2.0:1789120755.160684:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2bae5c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507520:0@lo:503: 00000100:00100000:2.0:1789120755.160727:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120755.160765:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000035853617 going to sleep for 11 seconds 00000100:00100000:3.0:1789120755.160958:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970507520 00000100:00100000:3.0:1789120755.160963:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970507520 00000100:00100000:3.0:1789120755.160982:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789120755.160998:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002ac6f4e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+14:7449:x1876028970507520:12345-0@lo:503: 00000040:00080000:3.0:1789120755.161050:0:6512:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120755.161099:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002ac6f4e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+14:7449:x1876028970507520:12345-0@lo:503: Request processed in 102us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120755.161106:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789120755.161192:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2bae5c6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507520:0@lo:503: 00000040:00080000:2.0:1789120755.161563:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120755.161628:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:2.0:1789120755.161722:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120755.163390:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:3.0:1789120755.164720:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789120755.164770:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789120755.165570:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120755.165591:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120755.165683:0:7449:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789120755.165687:0:7449:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946883582800 10000000:01000000:3.0:1789120755.165690:0:7449:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946883582800 10000000:01000000:3.0:1789120755.165695:0:7449:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789120755.165702:0:7449:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946883582800 from 1 10000000:01000000:3.0:1789120755.165705:0:7449:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789120755.165774:0:7449:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 000000009fb4546b/0xb74d2367a830efde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120755.165783:0:7449:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 000000009fb4546b/0xb74d2367a830efde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120755.165795:0:7449:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 000000009fb4546b/0xb74d2367a830efde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120755.165849:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbd7a8f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507648:0@lo:101: 00000100:00100000:3.0:1789120755.165940:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.167256:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038e363a3 going to sleep for 11 seconds 00000100:00100000:0.0:1789120755.168624:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970507648 00000100:00100000:0.0:1789120755.168641:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970507648 00000100:00100000:0.0:1789120755.168715:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789120755.168725:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba527d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+14:7449:x1876028970507648:12345-0@lo:101: 00010000:00010000:0.0:1789120755.168747:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120755.168769:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000053705638/0xb74d2367a830efe5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830efde expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.168850:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053705638/0xb74d2367a830efe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830efde expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.168862:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000053705638/0xb74d2367a830efe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830efde expref: 15 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.168872:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000053705638, rc 0) 00000100:00100000:0.0:1789120755.168966:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba527d40 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:7449:x1876028970507648:12345-0@lo:101: Request processed in 243us (3027us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.168973:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789120755.169512:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbd7a8f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507648:0@lo:101: 00010000:00010000:3.0:1789120755.169538:0:7449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 000000009fb4546b/0xb74d2367a830efde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120755.169548:0:7449:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 000000009fb4546b/0xb74d2367a830efde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120755.169718:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbd7a8f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507776:0@lo:501: 00000100:00100000:3.0:1789120755.169776:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.169855:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038e363a3 going to sleep for 11 seconds 00000100:00100000:3.0:1789120755.169879:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970507776 00000100:00100000:3.0:1789120755.169884:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970507776 00000100:00100000:3.0:1789120755.169948:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789120755.169957:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002a8b734a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:7449:x1876028970507776:12345-0@lo:501: 00000100:00100000:3.0:1789120755.170743:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002a8b734a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:7449:x1876028970507776:12345-0@lo:501: Request processed in 784us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120755.170753:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789120755.170807:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbd7a8f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507776:0@lo:501: 00000100:00100000:3.0:1789120755.170888:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbd7a8f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507904:0@lo:503: 00000100:00100000:3.0:1789120755.170935:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.170953:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038e363a3 going to sleep for 11 seconds 00000100:00100000:3.0:1789120755.170977:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970507904 00000100:00100000:3.0:1789120755.170981:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970507904 00000100:00100000:3.0:1789120755.172548:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789120755.172563:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018490bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:7449:x1876028970507904:12345-0@lo:503: 00000100:00100000:3.0:1789120755.172759:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018490bb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:7449:x1876028970507904:12345-0@lo:503: Request processed in 200us (1823us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120755.172767:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789120755.172874:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbd7a8f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970507904:0@lo:503: 00000040:00080000:3.0:1789120755.173941:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120755.174609:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cbd7a8f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970508032:0@lo:502: 00000100:00100000:3.0:1789120755.174692:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.174747:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 0000000038e363a3 going to sleep for 11 seconds 00000100:00100000:0.0:1789120755.174760:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970508032 00000100:00100000:0.0:1789120755.174768:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970508032 00000100:00100000:0.0:1789120755.174852:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789120755.174862:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a7cdda8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:7449:x1876028970508032:12345-0@lo:502: 00000100:00100000:0.0:1789120755.175014:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a7cdda8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:7449:x1876028970508032:12345-0@lo:502: Request processed in 153us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.175036:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789120755.175177:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cbd7a8f3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970508032:0@lo:502: 00000040:00080000:1.0:1789120755.175874:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789120755.175920:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789120755.175936:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789120755.175950:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789120755.175962:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789120755.175977:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789120755.175990:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789120755.176005:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789120755.176037:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789120755.176052:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789120755.176066:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789120755.176079:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789120755.176092:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789120755.178554:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789120755.178617:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789120755.178631:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789120755.178643:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789120755.178657:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789120755.179549:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789120755.179582:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789120755.179597:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789120755.179610:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789120755.179625:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789120755.179639:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789120755.179651:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:1.0:1789120755.180478:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:1.0:1789120755.180495:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:1.0:1789120755.180513:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:1.0:1789120755.180579:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970508160:0@lo:502: 00000100:00100000:1.0:1789120755.180705:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120755.180771:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000988c648c going to sleep for 11 seconds 00000100:00100000:3.0:1789120755.184074:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970508160 00000100:00100000:3.0:1789120755.184095:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970508160 00000100:00100000:3.0:1789120755.184196:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789120755.184207:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ddc6896 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:7449:x1876028970508160:12345-0@lo:502: 00000100:00100000:3.0:1789120755.184486:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ddc6896 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:7449:x1876028970508160:12345-0@lo:502: Request processed in 281us (3782us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120755.184494:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789120755.184791:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970508160:0@lo:502: 00000040:00080000:0.0:1789120755.189908:0:7449:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:0.0:1789120755.189956:0:7449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1789120755.197478:0:7467:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1789120755.197507:0:7467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000008166a191) 00000020:00000080:3.0:1789120755.197552:0:7467:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789120755.197718:0:7467:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f84658cb from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789120755.197724:0:7467:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f84658cb from lustre-MDT0001, refs=3 00000020:01000004:3.0:1789120755.197727:0:7467:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f84658cb 3 00010000:00080000:3.0:1789120755.197768:0:7467:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a7c687a9@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789120755.201416:0:7467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1789120755.201776:0:7467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1789120755.201948:0:7467:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789120755.201965:0:7467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb74d2367a830eff3 00000100:00080000:2.0:1789120755.202616:0:7467:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789120755.202625:0:7467:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 00000000a7c687a9 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789120755.202731:0:7467:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b2bae5c6 x1876028970508288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789120755.202760:0:7467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789120755.203469:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b2bae5c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876028970508288:0@lo:38: 00000100:00100000:3.0:1789120755.203570:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.203653:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970508288 00000100:00100000:3.0:1789120755.203662:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970508288 00000100:00100000:3.0:1789120755.203712:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120755.203719:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d034a925 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876028970508288:12345-0@lo:38: 00010000:00080000:3.0:1789120755.203750:0:6519:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:3.0:1789120755.203792:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb74d2367a830effa 00000004:00100000:3.0:1789120755.203810:0:6519:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789120755.203865:0:6519:0:(import.c:65:import_set_state_nolock()) 000000006d0704d5 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120755.203915:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d034a925 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876028970508288:12345-0@lo:38: Request processed in 195us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120755.203922:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1789120755.203964:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b2bae5c6 x1876028970508288/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120765 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120755.203985:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789120755.203994:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1789120755.204001:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789120755.204006:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789120755.204008:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000a7c687a9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789120755.204013:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b2bae5c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876028970508288:0@lo:38: 00000040:00080000:2.0:1789120755.204386:0:7467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1789120755.204804:0:7449:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1789120755.204865:0:7449:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789120755.204902:0:7449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 000000009fb4546b/0xb74d2367a830efde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120755.204913:0:7449:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 000000009fb4546b/0xb74d2367a830efde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789120755.204965:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789120755.204967:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789120755.204968:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120755.204969:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120755.204970:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120755.204972:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120755.204973:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789120755.204975:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120755.204976:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120755.204978:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120755.204988:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789120755.204992:0:7449:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:3.0:1789120755.204995:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789120755.204997:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789120755.204998:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120755.204999:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120755.205000:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120755.205002:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120755.205002:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789120755.205003:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120755.205004:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120755.205005:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120755.205006:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789120755.205062:0:7449:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789120755.205078:0:7449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c11c225 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970508416:0@lo:253: 00000100:00100000:3.0:1789120755.205442:0:7449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.205487:0:7449:0:(client.c:2715:ptlrpc_set_wait()) set 00000000564be7e2 going to sleep for 11 seconds 00000100:00100000:3.0:1789120755.205518:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970508416 00000100:00100000:3.0:1789120755.205524:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970508416 00000100:00100000:3.0:1789120755.205587:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789120755.205605:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f70fcdf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:7449:x1876028970508416:12345-0@lo:253: 20000000:01000000:3.0:1789120755.205639:0:6512:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789120755.205657:0:6512:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 40000000:00080000:0.0:1789120755.212475:0:7468:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000001:00100000:2.0:1789120755.214554:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1789120755.214712:0:6512:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789120755.214761:0:6512:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789120755.215132:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f70fcdf0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:7449:x1876028970508416:12345-0@lo:253: Request processed in 9524us (9687us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120755.215149:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789120755.215239:0:7449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c11c225 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:7449:1876028970508416:0@lo:253: 10000000:01000000:3.0:1789120755.215256:0:7449:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789120755.215260:0:7449:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789120755.215262:0:7449:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789120755.215263:0:7449:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120755.215264:0:7449:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120755.215265:0:7449:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120755.215267:0:7449:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120755.215268:0:7449:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789120755.215270:0:7449:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120755.215272:0:7449:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120755.215274:0:7449:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120755.215275:0:7449:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789120755.215294:0:7449:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1789120755.219234:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789120755.219242:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789120755.219269:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120755.219291:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000e4eab6c5/0xb74d2367a830ef21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ef13 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120755.219299:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000038c5adaf/0xb74d2367a830efc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830efc2 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120755.219306:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120755.219364:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000038c5adaf/0xb74d2367a830efc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830efc2 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120755.219383:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000038c5adaf/0xb74d2367a830efc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830efc2 expref: 14 pid: 6513 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120755.219401:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037bc4200 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970508544:0@lo:104: 00000100:00100000:2.0:1789120755.219495:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120755.219565:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000e4eab6c5/0xb74d2367a830ef21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830ef13 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120755.219573:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000e4eab6c5/0xb74d2367a830ef21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830ef13 expref: 14 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120755.219582:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d804d3c4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970508672:0@lo:104: 00000100:00100000:2.0:1789120755.219605:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120755.219622:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set 000000004a1055fd going to sleep for 11 seconds 00000100:00100000:2.0:1789120755.219649:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970508544 00000100:00100000:2.0:1789120755.219656:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970508544 00000100:00100000:2.0:1789120755.219695:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970508672 00000100:00100000:2.0:1789120755.219698:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970508672 00000100:00100000:2.0:1789120755.219712:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120755.219721:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000908e2b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:6534:x1876028970508544:12345-0@lo:104: 00010000:00010000:2.0:1789120755.219735:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120755.219805:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120755.219810:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000908e2b6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:6534:x1876028970508544:12345-0@lo:104: Request processed in 91us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120755.219852:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120755.219871:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789120755.219877:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000795117e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:6534:x1876028970508672:12345-0@lo:104: 00010000:00010000:2.0:1789120755.219884:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120755.219923:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789120755.219927:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000795117e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:6534:x1876028970508672:12345-0@lo:104: Request processed in 52us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120755.219932:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1789120755.220109:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789120755.220116:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220123:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000575abd1 already unused, calling callback (000000007f6132ca) 10000000:00010000:0.0:1789120755.220126:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220143:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120755.220150:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120755.220155:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120755.220206:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220213:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120755.220233:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220240:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: 000000000575abd1/0xb74d2367a830efc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830efc9 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220251:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120755.220253:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220258:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000f9a1a32 already unused, calling callback (000000007f6132ca) 10000000:00010000:0.0:1789120755.220260:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220266:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120755.220271:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120755.220282:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120755.220296:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220302:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120755.220306:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220312:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: 000000000f9a1a32/0xb74d2367a830ef13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ef21 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220327:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120755.220328:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120755.220329:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120755.220361:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c610c33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970508800:0@lo:103: 00000100:00100000:0.0:1789120755.220399:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120755.220434:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120755.220440:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f1581a18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970508928:0@lo:103: 00000100:00100000:0.0:1789120755.220463:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120755.220497:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970508800 00000100:00100000:0.0:1789120755.220502:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970508800 00010000:00010000:0.0:1789120755.220521:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000038c5adaf/0xb74d2367a830efc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830efc2 expref: 15 pid: 6513 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120755.220541:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970508928 00000100:00100000:0.0:1789120755.220543:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970508928 00010000:00010000:0.0:1789120755.220553:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000e4eab6c5/0xb74d2367a830ef21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830ef13 expref: 16 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120755.220576:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120755.220581:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0a86a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+16:3646:x1876028970508800:12345-0@lo:103: 00010000:00010000:0.0:1789120755.220592:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120755.220597:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000038c5adaf/0xb74d2367a830efc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830efc2 expref: 16 pid: 6513 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220605:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000038c5adaf/0xb74d2367a830efc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830efc2 expref: 16 pid: 6513 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220622:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120755.220648:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0a86a4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+16:3646:x1876028970508800:12345-0@lo:103: Request processed in 67us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.220653:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120755.220668:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120755.220672:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027aa02b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+15:3646:x1876028970508928:12345-0@lo:103: 00010000:00010000:0.0:1789120755.220678:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120755.220681:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000e4eab6c5/0xb74d2367a830ef21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830ef13 expref: 15 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220688:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000e4eab6c5/0xb74d2367a830ef21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830ef13 expref: 15 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220698:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220705:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789120755.220729:0:6504:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001487594s 00010000:00010000:0.0:1789120755.220733:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220740:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220746:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220752:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220757:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000af4e6f3f already unused, calling callback (0000000026fe3ef7) 00010000:00010000:0.0:1789120755.220761:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220766:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220773:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.220781:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120755.220800:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027aa02b5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+15:3646:x1876028970508928:12345-0@lo:103: Request processed in 129us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.220806:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120755.220912:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f1581a18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970508928:0@lo:103: 00000100:00100000:0.0:1789120755.220921:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c610c33 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970508800:0@lo:103: 00010000:00010000:0.0:1789120755.220970:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000038c5adaf/0xb74d2367a830efc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830efc2 expref: 14 pid: 6513 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120755.220982:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037bc4200 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970508544:0@lo:104: 00010000:00010000:0.0:1789120755.220991:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e4eab6c5/0xb74d2367a830ef21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830ef13 expref: 13 pid: 6512 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120755.220998:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d804d3c4 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970508672:0@lo:104: 00010000:00010000:0.0:1789120755.221012:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.221030:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.221035:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120755.221040:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000af4e6f3f/0xb74d2367a830f001 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120755.221293:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1789120755.222690:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:3.0:1789120755.223039:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1789120755.223366:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:3.0:1789120755.223560:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789120755.223752:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:2.0:1789120755.224477:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:2.0:1789120755.225447:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:2.0:1789120755.225689:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:2.0:1789120755.226035:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:2.0:1789120755.226276:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:2.0:1789120755.226450:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:2.0:1789120755.226613:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1789120755.230142:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789120755.230303:0:7472:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789120755.230307:0:7472:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789120755.231259:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:01000000:3.0:1789120755.231348:0:7473:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:3.0:1789120755.231424:0:7473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c11c225 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1876028970509056:0@lo:700: 00000100:00100000:3.0:1789120755.231521:0:7473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.232190:0:7473:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d39776f3 going to sleep for 11 seconds 00000100:00100000:0.0:1789120755.232412:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c610c33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876028970509184:0@lo:1000: 00000100:00100000:0.0:1789120755.232461:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120755.232500:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ade74f3f going to sleep for 11 seconds 00000100:00100000:3.0:1789120755.233953:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970509184 00000100:00100000:3.0:1789120755.233968:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970509184 00000100:00100000:3.0:1789120755.234060:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120755.234069:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1581a18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876028970509184:12345-0@lo:1000: 00000100:00100000:3.0:1789120755.234318:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1581a18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876028970509184:12345-0@lo:1000: Request processed in 251us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120755.234327:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120755.234412:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c610c33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876028970509184:0@lo:1000: 00000040:01000000:0.0:1789120755.234460:0:7474:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:0.0:1789120755.234500:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c610c33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876028970509312:0@lo:700: 00000100:00100000:0.0:1789120755.234550:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120755.234584:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da789398 going to sleep for 11 seconds 00000040:01000000:1.0:1789120755.235364:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1789120755.235508:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120755.237336:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970509312 00000100:00100000:3.0:1789120755.237355:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970509312 00000100:00100000:3.0:1789120755.237432:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789120755.237442:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8844622 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876028970509312:12345-0@lo:700: 00000100:00100000:3.0:1789120755.237565:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8844622 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876028970509312:12345-0@lo:700: Request processed in 125us (3015us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120755.237572:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00000080:1.0:1789120755.237816:0:7449:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789120755.237856:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1789120755.238361:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789120755.239148:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970509056 00000100:00100000:2.0:1789120755.239159:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970509056 00000100:00100000:0.0:1789120755.239312:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c610c33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876028970509312:0@lo:700: 00000100:00100000:2.0:1789120755.239329:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120755.239336:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000035ffc68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7473:x1876028970509056:12345-0@lo:700: 00000100:00100000:0.0:1789120755.239402:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007c610c33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876028970509440:0@lo:900: 00000100:00100000:0.0:1789120755.239477:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120755.239522:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000da789398 going to sleep for 11 seconds 00000100:00100000:2.0:1789120755.240266:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970509440 00000100:00100000:2.0:1789120755.240273:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970509440 00000100:00100000:2.0:1789120755.240326:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120755.240332:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000486376fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7474:x1876028970509440:12345-0@lo:900: 00000100:00100000:2.0:1789120755.240407:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000486376fd pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7474:x1876028970509440:12345-0@lo:900: Request processed in 74us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120755.240430:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1789120755.240693:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00010000:00080000:3.0:1789120755.241103:0:7474:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000007c610c33 x1876028970509440/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789120771 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120755.241119:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007c610c33 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7474:1876028970509440:0@lo:900: 00000100:00100000:3.0:1789120755.241276:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009de1df45 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876028970509568:0@lo:1000: 00000100:00100000:3.0:1789120755.241327:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120755.241375:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000297f3dbf going to sleep for 11 seconds 00000040:00080000:1.0:1789120755.242929:0:7449:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789120755.243039:0:7449:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1789120755.243569:0:7449:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789120755.244295:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970509568 00000100:00100000:0.0:1789120755.244308:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970509568 00000100:00100000:0.0:1789120755.244381:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789120755.244391:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de144bef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876028970509568:12345-0@lo:1000: 00000100:00100000:0.0:1789120755.244558:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de144bef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876028970509568:12345-0@lo:1000: Request processed in 168us (3231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120755.244567:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120755.244845:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009de1df45 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876028970509568:0@lo:1000: 00000004:00080000:2.0:1789120755.244929:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000bd7281ce with version 0 00000020:00100000:2.0:1789120755.244985:0:7474:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789120755.244994:0:7474:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000af9126c8 x1876028970509824/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789120755.245032:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000af9126c8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876028970509824:0@lo:1000: 00000100:00100000:2.0:1789120755.245081:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120755.245125:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c39f7486 going to sleep for 11 seconds 00000100:00100000:0.0:1789120755.245203:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970509824 00000100:00100000:0.0:1789120755.245208:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970509824 00000100:00100000:0.0:1789120755.245243:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120755.245250:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eea42e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876028970509824:12345-0@lo:1000: 00080000:10000000:1.0:1789120755.245429:0:7449:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1789120755.249985:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789120755.250942:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789120755.251186:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789120755.251337:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789120755.251500:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789120755.251714:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00000001:00080000:0.0:1789120755.251856:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 40000000:02000000:2.0:1789120755.251919:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:3.0:1789120755.252295:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eea42e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7474:x1876028970509824:12345-0@lo:1000: Request processed in 7039us (7207us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789120755.252310:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1789120755.252415:0:7474:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:0.0:1789120755.252421:0:7474:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789120755.252441:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000af9126c8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876028970509824:0@lo:1000: 00000100:00100000:0.0:1789120755.252549:0:7474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0a86a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876028970509952:0@lo:1000: 00000100:00100000:0.0:1789120755.252598:0:7474:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120755.252646:0:7474:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd7281ce going to sleep for 11 seconds 00000100:00100000:3.0:1789120755.252696:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970509952 00000100:00100000:3.0:1789120755.252703:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970509952 00000100:00100000:3.0:1789120755.252757:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789120755.252767:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba146573 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876028970509952:12345-0@lo:1000: 00000100:00100000:3.0:1789120755.252882:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba146573 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7474:x1876028970509952:12345-0@lo:1000: Request processed in 117us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120755.252889:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120755.253085:0:7474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0a86a4 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7474:1876028970509952:0@lo:1000: 00000040:00080000:0.0:1789120755.253223:0:7474:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1789120755.253263:0:7474:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 000000004a1055fd with version 1 00000004:00080000:0.0:1789120755.253284:0:7464:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000094bfe958 version 1 rpc_version 1 00000020:00100000:0.0:1789120755.253300:0:7464:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1789120755.253308:0:7464:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000ab0a86a4 x1876028970510208/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789120755.253322:0:7464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab0a86a4 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1876028970510208:0@lo:1000: 00000100:00100000:0.0:1789120755.253348:0:7464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120755.253373:0:7464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ade74f3f going to sleep for 11 seconds 00000100:00100000:3.0:1789120755.254984:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970510208 00000100:00100000:3.0:1789120755.254999:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970510208 00000100:00100000:3.0:1789120755.255075:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789120755.255085:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007c610c33 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1876028970510208:12345-0@lo:1000: 00100000:10000000:1.0:1789120755.255429:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789120755.255679:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789120755.255892:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789120755.256055:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789120755.256209:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789120755.256352:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789120755.256482:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789120755.256597:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789120755.256721:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789120755.256860:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00000040:00080000:0.0:1789120755.257494:0:7474:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789120755.257595:0:7474:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00100000:10000000:1.0:1789120755.261290:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789120755.261460:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789120755.261647:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789120755.261802:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00000100:00100000:2.0:1789120755.262008:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000035ffc68 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7473:x1876028970509056:12345-0@lo:700: Request processed in 22665us (30481us total) trans 0 rc 0/0 00010000:00080000:3.0:1789120755.262048:0:7473:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008c11c225 x1876028970509056/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789120771 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120755.262067:0:7473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c11c225 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7473:1876028970509056:0@lo:700: 40000000:02000000:3.0:1789120755.262084:0:7473:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00000100:00100000:2.0:1789120755.262086:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:1.0:1789120755.262778:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789120755.263270:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789120755.263421:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789120755.263596:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789120755.263745:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789120755.264293:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789120755.264436:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789120755.264590:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789120755.264742:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789120755.265002:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789120755.265386:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789120755.265525:0:7449:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789120755.265738:0:7449:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:0.0:1789120755.270862:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:3.0:1789120755.272055:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007c610c33 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7464:x1876028970510208:12345-0@lo:1000: Request processed in 16963us (18697us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789120755.272075:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000004:00080000:0.0:1789120755.272199:0:7464:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:0.0:1789120755.272206:0:7464:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789120755.272231:0:7464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab0a86a4 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7464:1876028970510208:0@lo:1000: 00000001:00080000:1.0:1789120755.272914:0:7449:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789120755.272957:0:7449:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa04ac1d8f988 00100000:10000000:1.0:1789120755.272967:0:7449:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789120755.276191:0:7449:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789120755.276245:0:7449:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789120755.276270:0:7449:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789120755.276295:0:7449:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789120755.277388:0:7449:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789120755.277600:0:7449:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000040:00080000:2.0:1789120755.292162:0:7473:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789120755.317281:0:7473:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789120755.317374:0:7473:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789120755.317381:0:7473:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1789120755.352344:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120756.382272:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120757.400650:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120758.422980:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120759.445240:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789120760.209939:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789120760.209951:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946883582800 from 4 10000000:01000000:2.0:1789120760.209958:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789120760.210035:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 0000000021e03af2/0xb74d2367a830f008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.210051:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 0000000021e03af2/0xb74d2367a830f008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.210085:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 0000000021e03af2/0xb74d2367a830f008 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120760.210115:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066e06b28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970510336:0@lo:101: 00000100:00100000:2.0:1789120760.210279:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120760.210345:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ddf18c7e going to sleep for 11 seconds 00000100:00100000:0.0:1789120760.210543:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000098a9cb09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970510592:0@lo:400: 00000100:00100000:0.0:1789120760.210582:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120760.210614:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120760.210620:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a31a2169 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970510464:0@lo:400: 00000100:00100000:0.0:1789120760.210648:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120760.210674:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bef918e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970510720:0@lo:400: 00000100:00100000:0.0:1789120760.210710:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120760.211062:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970510336 00000100:00100000:3.0:1789120760.211077:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970510336 00000100:00100000:2.0:1789120760.211230:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970510464 00000100:00100000:2.0:1789120760.211235:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970510464 00000100:00100000:2.0:1789120760.211270:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970510720 00000100:00100000:2.0:1789120760.211274:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970510720 00000100:00100000:2.0:1789120760.211292:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120760.211301:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000abd4f037 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970510464:12345-0@lo:400: 00000100:00100000:2.0:1789120760.211370:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000abd4f037 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970510464:12345-0@lo:400: Request processed in 70us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.211378:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120760.211395:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789120760.211401:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a686a4a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970510720:12345-0@lo:400: 00000100:00100000:2.0:1789120760.211433:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a686a4a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970510720:12345-0@lo:400: Request processed in 33us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.211439:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789120760.211490:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000bef918e9 x1876028970510720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120760.211506:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bef918e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970510720:0@lo:400: 00010000:00080000:2.0:1789120760.211544:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a31a2169 x1876028970510464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120776 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120760.211570:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a31a2169 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970510464:0@lo:400: 00000100:00100000:3.0:1789120760.211722:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789120760.211730:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce686443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+13:6515:x1876028970510336:12345-0@lo:101: 00010000:00010000:3.0:1789120760.211742:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120760.211763:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ba32d127/0xb74d2367a830f00f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f008 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120760.211791:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba32d127/0xb74d2367a830f00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f008 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120760.211803:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ba32d127/0xb74d2367a830f00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f008 expref: 14 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120760.211847:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ba32d127, rc 0) 00000100:00100000:3.0:1789120760.211882:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce686443 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+14:6515:x1876028970510336:12345-0@lo:101: Request processed in 153us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120760.211888:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789120760.211935:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970510592 00000100:00100000:3.0:1789120760.211940:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970510592 00000100:00100000:3.0:1789120760.211967:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789120760.211985:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0a86a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970510592:12345-0@lo:400: 00000100:00100000:3.0:1789120760.212026:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0a86a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970510592:12345-0@lo:400: Request processed in 54us (1444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120760.212031:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789120760.214463:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a5485b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970510848:0@lo:41: 00000100:00100000:2.0:1789120760.214565:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120760.214649:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970510848 00000100:00100000:2.0:1789120760.214657:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970510848 00000100:00100000:2.0:1789120760.214712:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789120760.214722:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af9126c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970510848:12345-0@lo:41: 00000004:00000024:2.0:1789120760.214767:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1789120760.214817:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af9126c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970510848:12345-0@lo:41: Request processed in 97us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.214858:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789120760.216376:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000098a9cb09 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970510592:0@lo:400: 00000100:00100000:2.0:1789120760.216432:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a5485b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970510848:0@lo:41: 00000100:00100000:2.0:1789120760.216458:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066e06b28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970510336:0@lo:101: 00010000:00010000:2.0:1789120760.216484:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 0000000021e03af2/0xb74d2367a830f008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.216498:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 0000000021e03af2/0xb74d2367a830f008 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120760.216583:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066e06b28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970510976:0@lo:256: 00000100:00100000:2.0:1789120760.216652:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120760.216706:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ddf18c7e going to sleep for 11 seconds 00000100:00100000:0.0:1789120760.220421:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970510976 00000100:00100000:0.0:1789120760.220444:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970510976 00000100:00100000:0.0:1789120760.220551:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789120760.220562:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbd96a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+14:6515:x1876028970510976:12345-0@lo:256: 20000000:01000000:0.0:1789120760.220597:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789120760.220626:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789120760.220629:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1789120760.220792:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbd96a0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+14:6515:x1876028970510976:12345-0@lo:256: Request processed in 232us (4141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120760.220801:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789120760.223506:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066e06b28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970510976:0@lo:256: 10000000:01000000:2.0:1789120760.223613:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789120760.223629:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 0000000021e03af2/0xb74d2367a830f008 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.223643:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 0000000021e03af2/0xb74d2367a830f008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120760.223657:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789120760.223660:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946886899000 from 21 10000000:01000000:2.0:1789120760.223664:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789120760.223709:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 000000008b2516bd/0xb74d2367a830f016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.223716:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 000000008b2516bd/0xb74d2367a830f016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.223725:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 000000008b2516bd/0xb74d2367a830f016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120760.223752:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066e06b28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970511104:0@lo:101: 00000100:00100000:2.0:1789120760.223886:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120760.223939:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000092b5d0ec going to sleep for 11 seconds 00000100:00100000:0.0:1789120760.224389:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970511104 00000100:00100000:0.0:1789120760.224398:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970511104 00000100:00100000:0.0:1789120760.224468:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789120760.224480:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000456ba695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+14:6515:x1876028970511104:12345-0@lo:101: 00010000:00010000:0.0:1789120760.224500:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120760.231026:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000024ffcb3e/0xb74d2367a830f01d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f016 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.231112:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000024ffcb3e/0xb74d2367a830f01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f016 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.232769:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000024ffcb3e/0xb74d2367a830f01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f016 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.232806:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000024ffcb3e, rc 0) 00000100:00100000:2.0:1789120760.232950:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000456ba695 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970511104:12345-0@lo:101: Request processed in 8471us (9062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.232960:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789120760.233315:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066e06b28 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970511104:0@lo:101: 00010000:00010000:1.0:1789120760.233346:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 000000008b2516bd/0xb74d2367a830f016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120760.233360:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 000000008b2516bd/0xb74d2367a830f016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120760.233460:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970511232:0@lo:501: 00000100:00100000:1.0:1789120760.233524:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.233569:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ac80c63 going to sleep for 11 seconds 00000100:00100000:1.0:1789120760.233594:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970511232 00000100:00100000:1.0:1789120760.233600:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970511232 00000100:00100000:1.0:1789120760.233645:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789120760.233654:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7dcc525 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970511232:12345-0@lo:501: 00000100:00100000:1.0:1789120760.233788:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7dcc525 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970511232:12345-0@lo:501: Request processed in 136us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120760.233797:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789120760.233879:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970511232:0@lo:501: 00000100:00100000:1.0:1789120760.233911:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970511360:0@lo:503: 00000100:00100000:1.0:1789120760.233964:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.234003:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000004ac80c63 going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.234231:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970511360 00000100:00100000:2.0:1789120760.234241:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970511360 00000100:00100000:2.0:1789120760.234292:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789120760.234299:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd8d9efb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970511360:12345-0@lo:503: 00000100:00100000:2.0:1789120760.234457:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd8d9efb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970511360:12345-0@lo:503: Request processed in 158us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.234465:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789120760.235306:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970511360:0@lo:503: 00000100:00100000:1.0:1789120760.235992:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:7656:1876028970511488:0@lo:502: 00000100:00100000:1.0:1789120760.236077:0:7656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.236202:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a8415c5 going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.237032:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970511488 00000100:00100000:2.0:1789120760.237048:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970511488 00000100:00100000:2.0:1789120760.237305:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789120760.237316:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003dfa1049 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:7656:x1876028970511488:12345-0@lo:502: 00000100:00100000:2.0:1789120760.237677:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003dfa1049 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:7656:x1876028970511488:12345-0@lo:502: Request processed in 362us (1599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.237688:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789120760.237768:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:7656:1876028970511488:0@lo:502: 00000100:00100000:1.0:1789120760.237902:0:7656:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:7656:1876028970511616:0@lo:502: 00000100:00100000:1.0:1789120760.237989:0:7656:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.238043:0:7656:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a8415c5 going to sleep for 11 seconds 00000100:00100000:0.0:1789120760.238434:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970511616 00000100:00100000:0.0:1789120760.238444:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970511616 00000100:00100000:0.0:1789120760.238499:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789120760.238507:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9d9dbd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:7656:x1876028970511616:12345-0@lo:502: 00000100:00100000:0.0:1789120760.238639:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9d9dbd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:7656:x1876028970511616:12345-0@lo:502: Request processed in 133us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120760.238647:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789120760.238694:0:7656:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:7656:1876028970511616:0@lo:502: 00000040:00080000:1.0:1789120760.238729:0:7656:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789120760.239254:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789120760.239288:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789120760.239299:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 000000008b2516bd/0xb74d2367a830f016 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120760.239488:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 000000008b2516bd/0xb74d2367a830f016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120760.239500:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789120760.239503:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946886899000 from 4 10000000:01000000:0.0:1789120760.239507:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789120760.239546:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000df1c4c71/0xb74d2367a830f024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120760.239552:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000df1c4c71/0xb74d2367a830f024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120760.239562:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000df1c4c71/0xb74d2367a830f024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120760.239584:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a5485b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970511744:0@lo:101: 00000100:00100000:0.0:1789120760.239640:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120760.239689:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090814503 going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.240529:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970511744 00000100:00100000:2.0:1789120760.240540:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970511744 00000100:00100000:2.0:1789120760.240603:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789120760.240613:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ee19fea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970511744:12345-0@lo:101: 00010000:00010000:2.0:1789120760.240630:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120760.240648:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000eb311c60/0xb74d2367a830f02b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f024 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.240694:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000eb311c60/0xb74d2367a830f02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f024 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.240703:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000eb311c60/0xb74d2367a830f02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f024 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.240712:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000eb311c60, rc 0) 00000100:00100000:2.0:1789120760.240782:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ee19fea6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970511744:12345-0@lo:101: Request processed in 171us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.240788:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789120760.240940:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a5485b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970511744:0@lo:101: 00010000:00010000:0.0:1789120760.240958:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000df1c4c71/0xb74d2367a830f024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120760.240967:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000df1c4c71/0xb74d2367a830f024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120760.241046:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a5485b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970511872:0@lo:256: 00000100:00100000:0.0:1789120760.241085:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.241150:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970511872 00000100:00100000:1.0:1789120760.241165:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970511872 00000100:00100000:1.0:1789120760.241235:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789120760.241245:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bff31cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970511872:12345-0@lo:256: 20000000:01000000:1.0:1789120760.241270:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789120760.241292:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789120760.241295:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1789120760.241417:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bff31cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970511872:12345-0@lo:256: Request processed in 173us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120760.241427:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789120760.242247:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000090814503 going to sleep for 11 seconds 00000100:00100000:0.0:1789120760.242280:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a5485b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970511872:0@lo:256: 10000000:01000000:0.0:1789120760.242500:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789120760.242510:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000df1c4c71/0xb74d2367a830f024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120760.242522:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000df1c4c71/0xb74d2367a830f024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120760.242533:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789120760.242536:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789120760.242539:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789120760.242573:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 000000007141efa2/0xb74d2367a830f032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120760.242580:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 000000007141efa2/0xb74d2367a830f032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120760.242588:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 000000007141efa2/0xb74d2367a830f032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120760.242605:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a5485b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970512000:0@lo:101: 00000100:00100000:0.0:1789120760.242659:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120760.242687:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b5baef1 going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.242866:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970512000 00000100:00100000:2.0:1789120760.242873:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970512000 00000100:00100000:2.0:1789120760.242925:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789120760.242934:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b909cbba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970512000:12345-0@lo:101: 00010000:00010000:2.0:1789120760.242948:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120760.242962:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003780c61e/0xb74d2367a830f039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f032 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.242998:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003780c61e/0xb74d2367a830f039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f032 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.243009:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003780c61e/0xb74d2367a830f039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f032 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.243018:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003780c61e, rc 0) 00000100:00100000:0.0:1789120760.243229:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a5485b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970512000:0@lo:101: 00010000:00010000:0.0:1789120760.243243:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 000000007141efa2/0xb74d2367a830f032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120760.243252:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 000000007141efa2/0xb74d2367a830f032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120760.243396:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b909cbba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970512000:12345-0@lo:101: Request processed in 464us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.243405:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789120760.243486:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064a5485b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970512128:0@lo:501: 00000100:00100000:0.0:1789120760.243518:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.244308:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000009b5baef1 going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.244464:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970512128 00000100:00100000:2.0:1789120760.244472:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970512128 00000100:00100000:2.0:1789120760.244525:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789120760.244534:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d4c7dac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970512128:12345-0@lo:501: 00000100:00100000:2.0:1789120760.244708:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d4c7dac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970512128:12345-0@lo:501: Request processed in 175us (1189us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.244716:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789120760.244772:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064a5485b pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970512128:0@lo:501: 00000100:00100000:1.0:1789120760.244872:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970512256:0@lo:503: 00000100:00100000:1.0:1789120760.244963:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.245012:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 000000005647e535 going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.245034:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970512256 00000100:00100000:2.0:1789120760.245040:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970512256 00000100:00100000:2.0:1789120760.245083:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789120760.245090:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000084b6703c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970512256:12345-0@lo:503: 00000100:00100000:1.0:1789120760.245359:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970512256:0@lo:503: 00000100:00100000:2.0:1789120760.245571:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000084b6703c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970512256:12345-0@lo:503: Request processed in 480us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.245581:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789120760.247050:0:7657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:7657:1876028970512384:0@lo:502: 00000100:00100000:1.0:1789120760.247137:0:7657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.247177:0:7657:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002773a70 going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.247414:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970512384 00000100:00100000:2.0:1789120760.247425:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970512384 00000100:00100000:2.0:1789120760.247542:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789120760.247553:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bcec1f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:7657:x1876028970512384:12345-0@lo:502: 00000100:00100000:2.0:1789120760.247753:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bcec1f9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:7657:x1876028970512384:12345-0@lo:502: Request processed in 201us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.247762:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789120760.251478:0:7657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:7657:1876028970512384:0@lo:502: 00000020:01000000:0.0:1789120760.251544:0:7657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120760.251566:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120760.251570:0:7657:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789120760.251576:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789120760.251580:0:7657:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:00000080:0.0:1789120760.251614:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789120760.251635:0:7657:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000caac33a8) 00000020:00000080:0.0:1789120760.251664:0:7657:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:0.0:1789120760.251670:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789120760.251812:0:7657:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789120760.251838:0:7657:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789120760.251847:0:7657:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a830f047 00010000:00080000:0.0:1789120760.251883:0:7657:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000fe609dc9@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789120760.253642:0:7657:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:1.0:1789120760.255510:0:7657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789120760.255535:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789120760.255586:0:7657:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789120760.255617:0:7657:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a830f04e 00000100:00080000:1.0:1789120760.255631:0:7657:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789120760.255639:0:7657:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000fe609dc9 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789120760.255690:0:7657:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000a76e52e x1876028970512512/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789120760.255729:0:7657:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:1.0:1789120760.255814:0:7657:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:2.0:1789120760.256040:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000a76e52e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970512512:0@lo:38: 00000100:00100000:2.0:1789120760.256289:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.256593:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970512512 00000100:00100000:1.0:1789120760.256603:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970512512 00000100:00100000:1.0:1789120760.256643:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789120760.256653:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d804d3c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970512512:12345-0@lo:38: 00010000:00080000:1.0:1789120760.256695:0:6524:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 210 last 0 00000020:00000080:1.0:1789120760.256741:0:6524:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a830f055 00000004:00100000:1.0:1789120760.256762:0:6524:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789120760.256769:0:6524:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:1.0:1789120760.268401:0:7657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120760.268418:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120760.268420:0:7657:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789120760.268425:0:7657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120760.268430:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120760.268432:0:7657:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789120760.268434:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789120760.268436:0:7657:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789120760.268500:0:7657:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097829dea pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:7657:1876028970512640:0@lo:502: 00000100:00100000:1.0:1789120760.268608:0:7657:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.268671:0:7657:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002a5dd48 going to sleep for 11 seconds 00000100:00080000:1.0:1789120760.268770:0:7660:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@000000008464d186 x1876028970512768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120760.268779:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c39f1c6 going to sleep for 0 seconds 00000100:00100000:0.0:1789120760.269669:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970512640 00000100:00100000:0.0:1789120760.269680:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970512640 00000100:00100000:0.0:1789120760.269748:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789120760.269758:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4d4a9b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:7657:x1876028970512640:12345-0@lo:502: 00000100:00100000:0.0:1789120760.269987:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4d4a9b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:7657:x1876028970512640:12345-0@lo:502: Request processed in 230us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120760.269996:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789120760.270069:0:7657:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097829dea pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:7657:1876028970512640:0@lo:502: 00000020:01000000:0.0:1789120760.271495:0:7657:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120760.271527:0:7657:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120760.271531:0:7657:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789120760.271537:0:7657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1789120760.271755:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1789120760.271785:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789120760.271798:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 000000007141efa2/0xb74d2367a830f032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.271849:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 000000007141efa2/0xb74d2367a830f032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120760.271863:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789120760.271866:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9468ab900000 from 1 10000000:01000000:2.0:1789120760.271869:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789120760.271916:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 00000000af4e6f3f/0xb74d2367a830f05c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.271922:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 00000000af4e6f3f/0xb74d2367a830f05c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.271932:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 00000000af4e6f3f/0xb74d2367a830f05c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120760.271956:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037bc4200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970512896:0@lo:101: 00000100:00100000:2.0:1789120760.272065:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120760.272113:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d962559d going to sleep for 11 seconds 00000100:00100000:0.0:1789120760.272216:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970512896 00000100:00100000:0.0:1789120760.272224:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970512896 00000100:00100000:0.0:1789120760.272275:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789120760.272284:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000092073c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970512896:12345-0@lo:101: 00010000:00010000:0.0:1789120760.272299:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120760.272315:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042867a99/0xb74d2367a830f063 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f05c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789120760.272889:0:6524:0:(import.c:65:import_set_state_nolock()) 00000000e7df70ea : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120760.272980:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d804d3c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876028970512512:12345-0@lo:38: Request processed in 16316us (16681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120760.272991:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789120760.273053:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789120760.273063:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1789120760.273073:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1789120760.273079:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1789120760.273081:0:3643:0:(import.c:65:import_set_state_nolock()) 00000000fe609dc9 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789120760.273097:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000009c39f1c6): req@000000008464d186 x1876028970512768/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120760.273113:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000a76e52e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970512512:0@lo:38: 00010000:00010000:0.0:1789120760.273238:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042867a99/0xb74d2367a830f063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f05c expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120760.273252:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042867a99/0xb74d2367a830f063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f05c expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120760.273277:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042867a99, rc 0) 00000100:00100000:0.0:1789120760.273310:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000092073c48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970512896:12345-0@lo:101: Request processed in 1028us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120760.273317:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789120760.273600:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037bc4200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970512896:0@lo:101: 00010000:00010000:2.0:1789120760.273619:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 00000000af4e6f3f/0xb74d2367a830f05c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120760.273629:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 00000000af4e6f3f/0xb74d2367a830f05c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120760.273713:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037bc4200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970513024:0@lo:501: 00000100:00100000:2.0:1789120760.273747:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120760.273790:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d962559d going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.273864:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120760.273874:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000545c8ddc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970513152:0@lo:41: 00000100:00100000:2.0:1789120760.273903:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120760.273943:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970513152 00000100:00100000:2.0:1789120760.273949:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970513152 00000100:00100000:2.0:1789120760.273995:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789120760.274003:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2bae5c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970513152:12345-0@lo:41: 00000004:00000024:2.0:1789120760.274032:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789120760.274069:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2bae5c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970513152:12345-0@lo:41: Request processed in 67us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.274075:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789120760.274107:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000545c8ddc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970513152:0@lo:41: 00000100:00100000:0.0:1789120760.274221:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970513024 00000100:00100000:0.0:1789120760.274225:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970513024 00000100:00100000:0.0:1789120760.274250:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789120760.274255:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008dc1849f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970513024:12345-0@lo:501: 00000100:00100000:0.0:1789120760.275262:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008dc1849f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970513024:12345-0@lo:501: Request processed in 1000us (1508us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120760.275273:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789120760.275614:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037bc4200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970513024:0@lo:501: 10000000:01000000:0.0:1789120760.275674:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789120760.275684:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: 00000000af4e6f3f/0xb74d2367a830f05c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120760.275695:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: 00000000af4e6f3f/0xb74d2367a830f05c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120760.278662:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.278722:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c39f1c6 going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.281006:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970512768 00000100:00100000:2.0:1789120760.281027:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970512768 00000100:00100000:2.0:1789120760.281123:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789120760.281135:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a76e52e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7660:x1876028970512768:12345-0@lo:1000: 00000100:00100000:2.0:1789120760.281305:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a76e52e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7660:x1876028970512768:12345-0@lo:1000: Request processed in 172us (2658us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.281313:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789120760.281539:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7660:1876028970512768:0@lo:1000: 00000040:01000000:1.0:1789120760.281589:0:7660:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789120760.281640:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7660:1876028970513280:0@lo:1000: 00000100:00100000:1.0:1789120760.281689:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.281732:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set 000000009c39f1c6 going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.281780:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970513280 00000100:00100000:2.0:1789120760.281784:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970513280 00000100:00100000:2.0:1789120760.281811:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120760.281816:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063519218 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7660:x1876028970513280:12345-0@lo:1000: 00000100:00100000:2.0:1789120760.281979:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063519218 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7660:x1876028970513280:12345-0@lo:1000: Request processed in 154us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.281985:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789120760.282074:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7660:1876028970513280:0@lo:1000: 00000100:00100000:1.0:1789120760.282124:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7660:1876028970513408:0@lo:700: 00000100:00100000:1.0:1789120760.282152:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.282167:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set 000000001a817d7c going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.282270:0:6527:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970513408 00000100:00100000:2.0:1789120760.282274:0:6527:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970513408 00000100:00100000:2.0:1789120760.282312:0:6527:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120760.282386:0:6527:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000097829dea pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7660:x1876028970513408:12345-0@lo:700: 00000100:00100000:2.0:1789120760.282440:0:6527:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000097829dea pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7660:x1876028970513408:12345-0@lo:700: Request processed in 123us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.282447:0:6527:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789120760.283515:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7660:1876028970513408:0@lo:700: 00000100:00100000:1.0:1789120760.283755:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7660:1876028970513536:0@lo:1000: 00000100:00100000:1.0:1789120760.283845:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.283872:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5e21a96 going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.283937:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970513536 00000100:00100000:2.0:1789120760.283942:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970513536 00000100:00100000:2.0:1789120760.284000:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789120760.284009:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2a21372 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7660:x1876028970513536:12345-0@lo:1000: 00000100:00100000:2.0:1789120760.284096:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2a21372 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7660:x1876028970513536:12345-0@lo:1000: Request processed in 88us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120760.284104:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789120760.284254:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008464d186 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7660:1876028970513536:0@lo:1000: 00000004:00080000:1.0:1789120760.284311:0:7660:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 000000001a817d7c with version 0 00000020:00100000:1.0:1789120760.285229:0:7660:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:1.0:1789120760.285245:0:7660:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000d1430bd4 x1876028970513792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789120760.285267:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d1430bd4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7660:1876028970513792:0@lo:1000: 00000100:00100000:1.0:1789120760.285660:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120760.285726:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970513792 00000100:00100000:1.0:1789120760.285733:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970513792 00000100:00100000:1.0:1789120760.285788:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789120760.285797:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e615ad53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7660:x1876028970513792:12345-0@lo:1000: 00000100:00100000:3.0:1789120760.286774:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set 0000000002a5dd48 going to sleep for 11 seconds 00000001:00080000:3.0:1789120760.289588:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1789120760.289608:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789120760.289857:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e615ad53 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7660:x1876028970513792:12345-0@lo:1000: Request processed in 4054us (4529us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789120760.289875:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1789120760.290034:0:7660:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:3.0:1789120760.290041:0:7660:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789120760.290062:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d1430bd4 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7660:1876028970513792:0@lo:1000: 00000100:00100000:3.0:1789120760.291010:0:7660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0901ba7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7660:1876028970513920:0@lo:1000: 00000100:00100000:3.0:1789120760.291083:0:7660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120760.291198:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970513920 00000100:00100000:3.0:1789120760.291207:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970513920 00000100:00100000:3.0:1789120760.291267:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789120760.291276:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbd7a8f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7660:x1876028970513920:12345-0@lo:1000: 00000100:00100000:3.0:1789120760.291566:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbd7a8f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7660:x1876028970513920:12345-0@lo:1000: Request processed in 290us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120760.291589:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789120760.291634:0:7660:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058dd5a6c going to sleep for 11 seconds 00000100:00100000:3.0:1789120760.291660:0:7660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0901ba7 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7660:1876028970513920:0@lo:1000: 00000040:00080000:3.0:1789120760.291688:0:7660:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:3.0:1789120760.291724:0:7660:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000016790174 with version 1 00000004:00080000:2.0:1789120760.292419:0:7658:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000ddf18c7e version 1 rpc_version 1 00000020:00100000:2.0:1789120760.292450:0:7658:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1789120760.292460:0:7658:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000545c8ddc x1876028970514176/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789120760.292484:0:7658:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000545c8ddc pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7658:1876028970514176:0@lo:1000: 00000100:00100000:2.0:1789120760.292537:0:7658:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120760.292571:0:7658:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d962559d going to sleep for 11 seconds 00000100:00100000:2.0:1789120760.293531:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970514176 00000100:00100000:2.0:1789120760.293545:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970514176 00000100:00100000:2.0:1789120760.293613:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789120760.293622:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cb1dddf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7658:x1876028970514176:12345-0@lo:1000: 00000040:00080000:3.0:1789120760.295097:0:7660:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789120760.295482:0:7660:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789120760.295489:0:7660:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1789120760.302104:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:3.0:1789120760.302375:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cb1dddf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7658:x1876028970514176:12345-0@lo:1000: Request processed in 8749us (9834us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789120760.302391:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000004:00080000:2.0:1789120760.302553:0:7658:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1789120760.302559:0:7658:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1789120760.302581:0:7658:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000545c8ddc pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7658:1876028970514176:0@lo:1000: 00010000:00010000:1.0:1789120760.466000:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120761.498307:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789120761.683497:0:7724:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789120762.518111:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789120762.638214:0:7776:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789120762.638454:0:7776:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789120763.538272:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120764.566243:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120765.330395:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000545c8ddc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970514304:0@lo:41: 00000100:00100000:2.0:1789120765.330504:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120765.330602:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970514304 00000100:00100000:2.0:1789120765.330613:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970514304 00000100:00100000:2.0:1789120765.330676:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789120765.330687:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a45e847 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970514304:12345-0@lo:41: 00000004:00000024:2.0:1789120765.330738:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1789120765.330788:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a45e847 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970514304:12345-0@lo:41: Request processed in 103us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120765.330796:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789120765.331089:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000753fb5d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970514432:0@lo:41: 00000100:00100000:2.0:1789120765.331231:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000545c8ddc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970514304:0@lo:41: 00000100:00100000:1.0:1789120765.337190:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120765.337401:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000fc4e6358 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970514688:0@lo:400: 00000100:00100000:1.0:1789120765.337442:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120765.337466:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120765.337471:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f578546f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970514816:0@lo:400: 00000100:00100000:1.0:1789120765.337514:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120765.337554:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970514688 00000100:00100000:1.0:1789120765.337564:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970514688 00000100:00100000:1.0:1789120765.337620:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970514816 00000100:00100000:1.0:1789120765.337623:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970514816 00000100:00100000:1.0:1789120765.337643:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789120765.337652:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed2ad52f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970514688:12345-0@lo:400: 00000100:00100000:1.0:1789120765.337717:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed2ad52f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970514688:12345-0@lo:400: Request processed in 65us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120765.337725:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789120765.337743:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789120765.337749:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055d59e61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970514816:12345-0@lo:400: 00000100:00100000:1.0:1789120765.337776:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055d59e61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970514816:12345-0@lo:400: Request processed in 27us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120765.337781:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789120765.337805:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000064892a1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970514560:0@lo:400: 00000100:00100000:1.0:1789120765.339283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789120765.339389:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000f578546f x1876028970514816/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120765.339409:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f578546f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970514816:0@lo:400: 00010000:00080000:1.0:1789120765.339425:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000fc4e6358 x1876028970514688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120781 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120765.339433:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000fc4e6358 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970514688:0@lo:400: 00000100:00100000:3.0:1789120765.339552:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970514432 00000100:00100000:3.0:1789120765.339559:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970514432 00000100:00100000:3.0:1789120765.339614:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789120765.339622:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ebe15423 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970514432:12345-0@lo:41: 00000004:00000024:3.0:1789120765.339674:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:3.0:1789120765.339737:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ebe15423 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970514432:12345-0@lo:41: Request processed in 116us (2560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120765.339745:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789120765.339814:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970514560 00000100:00100000:2.0:1789120765.339850:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970514560 00000100:00100000:2.0:1789120765.339963:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789120765.339971:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d499237a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:3647:x1876028970514560:12345-0@lo:400: 00000100:00100000:2.0:1789120765.340359:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d499237a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:3647:x1876028970514560:12345-0@lo:400: Request processed in 387us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120765.340367:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789120765.340475:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000064892a1e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970514560:0@lo:400: 00000100:00100000:1.0:1789120765.340568:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000753fb5d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970514432:0@lo:41: 00000020:00000004:0.0:1789120765.400727:0:7877:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789120765.401322:0:7877:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789120765.587757:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120766.611956:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789120766.661385:0:7925:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc7d88590 20000000:00000080:3.0:1789120766.661412:0:7925:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9468b97f0000 uarg=0000000000000000 20000000:01000000:3.0:1789120766.661579:0:7925:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789120766.661588:0:7925:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789120766.661595:0:7925:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789120766.661695:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789120766.661709:0:7925:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789120766.671666:0:7925:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789120766.672015:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789120766.672070:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789120766.672092:0:7925:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789120766.672113:0:7925:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789120766.672137:0:7925:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.672161:0:7925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ef4be510/0xb74d2367a830eee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830eee2 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.672169:0:7925:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000aeacd32/0xb74d2367a830efd7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830efd0 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.672177:0:7925:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.672254:0:7925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000aeacd32/0xb74d2367a830efd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830efd0 expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.672273:0:7925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000aeacd32/0xb74d2367a830efd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830efd0 expref: 17 pid: 6510 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120766.672303:0:7925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005f988a2e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876028970514944:0@lo:104: 00000100:00100000:0.0:1789120766.672404:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120766.672733:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789120766.672753:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970514944 00000100:00100000:1.0:1789120766.672762:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970514944 00000100:00100000:1.0:1789120766.672861:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789120766.672872:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eef9eb3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:7925:x1876028970514944:12345-0@lo:104: 00010000:00010000:1.0:1789120766.672889:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120766.672963:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789120766.672969:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eef9eb3b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:7925:x1876028970514944:12345-0@lo:104: Request processed in 99us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120766.672977:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789120766.673050:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120766.673068:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120766.673077:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000d7b1e74e already unused, calling callback (000000007f6132ca) 10000000:00010000:1.0:1789120766.673080:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120766.673089:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120766.673096:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120766.673102:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789120766.673139:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120766.673161:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120766.673183:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120766.673190:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: 00000000d7b1e74e/0xb74d2367a830efd0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830efd7 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120766.673205:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120766.673207:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120766.673209:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120766.673234:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000753fb5d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970515072:0@lo:103: 00000100:00100000:1.0:1789120766.673270:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120766.673589:0:7925:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ef4be510/0xb74d2367a830eee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830eee2 expref: 17 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.673601:0:7925:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ef4be510/0xb74d2367a830eee9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830eee2 expref: 17 pid: 6513 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120766.673610:0:7925:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060c587a9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876028970515200:0@lo:104: 00000100:00100000:0.0:1789120766.673643:0:7925:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120766.673663:0:7925:0:(client.c:2715:ptlrpc_set_wait()) set 00000000caafc236 going to sleep for 11 seconds 00000100:00100000:0.0:1789120766.673689:0:7925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005f988a2e pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876028970514944:0@lo:104: 00000100:00100000:1.0:1789120766.673776:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970515200 00000100:00100000:1.0:1789120766.673781:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970515200 00000100:00100000:1.0:1789120766.673814:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789120766.673838:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eced074e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:7925:x1876028970515200:12345-0@lo:104: 00010000:00010000:1.0:1789120766.673848:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120766.673886:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789120766.673891:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eced074e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:7925:x1876028970515200:12345-0@lo:104: Request processed in 72us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120766.673897:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789120766.673974:0:7925:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060c587a9 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7925:1876028970515200:0@lo:104: 00010000:00010000:0.0:1789120766.673999:0:7925:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120766.674181:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970515072 00000100:00100000:3.0:1789120766.674186:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970515072 00010000:00010000:3.0:1789120766.674209:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000aeacd32/0xb74d2367a830efd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830efd0 expref: 18 pid: 6510 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120766.674231:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789120766.674237:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc4e6358 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+18:3646:x1876028970515072:12345-0@lo:103: 00010000:00010000:3.0:1789120766.674248:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120766.674253:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000aeacd32/0xb74d2367a830efd7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830efd0 expref: 18 pid: 6510 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120766.674261:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000aeacd32/0xb74d2367a830efd7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830efd0 expref: 18 pid: 6510 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120766.674279:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000aeacd32/0xb74d2367a830efd7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830efd0 expref: 18 pid: 6510 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120766.674295:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120766.674328:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc4e6358 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+17:3646:x1876028970515072:12345-0@lo:103: Request processed in 93us (1059us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120766.674335:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1789120766.674353:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120766.674357:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120766.674363:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c13308c5 already unused, calling callback (000000007f6132ca) 10000000:00010000:3.0:1789120766.674376:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120766.674383:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120766.674389:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120766.674395:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789120766.674417:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120766.674424:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120766.674433:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120766.674439:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: 00000000c13308c5/0xb74d2367a830eee2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830eee9 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120766.674454:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120766.674455:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120766.674457:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120766.675409:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000097a48892 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970515328:0@lo:103: 00000100:00100000:3.0:1789120766.675463:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120766.675963:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000753fb5d0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970515072:0@lo:103: 00000100:00100000:0.0:1789120766.676318:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970515328 00000100:00100000:0.0:1789120766.676325:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970515328 00010000:00010000:0.0:1789120766.676362:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ef4be510/0xb74d2367a830eee9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830eee2 expref: 17 pid: 6513 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120766.676429:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789120766.676437:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000053cdb499 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+17:3647:x1876028970515328:12345-0@lo:103: 00010000:00010000:0.0:1789120766.676453:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120766.676457:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ef4be510/0xb74d2367a830eee9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830eee2 expref: 17 pid: 6513 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.676497:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ef4be510/0xb74d2367a830eee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830eee2 expref: 17 pid: 6513 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.676517:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ef4be510/0xb74d2367a830eee9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830eee2 expref: 17 pid: 6513 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.676532:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.676541:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.676560:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.676567:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.676573:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.676579:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.676584:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bdc2fbcc already unused, calling callback (0000000026fe3ef7) 00010000:00010000:0.0:1789120766.676588:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.676596:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120766.676815:0:7925:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120766.676851:0:7925:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.682957:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.682983:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bdc2fbcc/0xb74d2367a830f06a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7925 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120766.683009:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120766.683136:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000053cdb499 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+16:3647:x1876028970515328:12345-0@lo:103: Request processed in 6694us (7666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120766.683148:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789120766.683404:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000097a48892 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970515328:0@lo:103: 00010000:00010000:0.0:1789120767.636966:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120768.658091:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789120769.425919:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120769.425931:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946883582800 from 1 10000000:01000000:2.0:1789120769.425936:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120769.426013:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: 0000000078720787/0xb74d2367a830f071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.426036:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: 0000000078720787/0xb74d2367a830f071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.426061:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: 0000000078720787/0xb74d2367a830f071 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120769.426093:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000545c8ddc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970515456:0@lo:101: 00000100:00100000:2.0:1789120769.426193:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120769.426267:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f590218d going to sleep for 11 seconds 00000100:00100000:3.0:1789120769.426508:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970515456 00000100:00100000:3.0:1789120769.426537:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970515456 00000100:00100000:3.0:1789120769.426608:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789120769.426618:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a53cdbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970515456:12345-0@lo:101: 00010000:00010000:3.0:1789120769.426636:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120769.426655:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef4be510/0xb74d2367a830f078 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f071 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.426686:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef4be510/0xb74d2367a830f078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f071 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.426699:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef4be510/0xb74d2367a830f078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f071 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120769.426710:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef4be510, rc 0) 00000100:00100000:3.0:1789120769.426769:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a53cdbbe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970515456:12345-0@lo:101: Request processed in 153us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120769.426777:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789120769.426812:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000545c8ddc pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970515456:0@lo:101: 00010000:00010000:0.0:1789120769.426867:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: 0000000078720787/0xb74d2367a830f071 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120769.426876:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: 0000000078720787/0xb74d2367a830f071 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120769.426964:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b40ddcd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970515584:0@lo:501: 00000100:00100000:0.0:1789120769.427756:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120769.427814:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970515584 00000100:00100000:0.0:1789120769.427817:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005b3f428 going to sleep for 11 seconds 00000100:00100000:2.0:1789120769.427874:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970515584 00000100:00100000:2.0:1789120769.427924:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789120769.427932:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b005cb62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970515584:12345-0@lo:501: 00000100:00100000:2.0:1789120769.428088:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b005cb62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970515584:12345-0@lo:501: Request processed in 156us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120769.428095:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789120769.428310:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b40ddcd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970515584:0@lo:501: 00000100:00100000:0.0:1789120769.428354:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b40ddcd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970515712:0@lo:503: 00000100:00100000:0.0:1789120769.428416:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120769.428444:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set 0000000005b3f428 going to sleep for 11 seconds 00000100:00100000:2.0:1789120769.428600:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970515712 00000100:00100000:2.0:1789120769.428606:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970515712 00000100:00100000:2.0:1789120769.428642:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789120769.428648:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a46fa57a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970515712:12345-0@lo:503: 00000100:00100000:2.0:1789120769.428755:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a46fa57a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970515712:12345-0@lo:503: Request processed in 107us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120769.428762:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789120769.428861:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b40ddcd7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970515712:0@lo:503: 00000100:00100000:3.0:1789120769.439682:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0901ba7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8009:1876028970515840:0@lo:502: 00000100:00100000:3.0:1789120769.439814:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120769.439914:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set 0000000082158757 going to sleep for 11 seconds 00000100:00100000:2.0:1789120769.440050:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970515840 00000100:00100000:2.0:1789120769.440059:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970515840 00000100:00100000:2.0:1789120769.440121:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789120769.440130:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ab55598a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:8009:x1876028970515840:12345-0@lo:502: 00000100:00100000:2.0:1789120769.440291:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ab55598a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:8009:x1876028970515840:12345-0@lo:502: Request processed in 162us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120769.440300:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789120769.440627:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0901ba7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8009:1876028970515840:0@lo:502: 00000020:01000000:3.0:1789120769.440669:0:8009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120769.440681:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120769.440684:0:8009:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789120769.440691:0:8009:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946883582800 00000020:00000080:3.0:1789120769.440695:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120769.440756:0:8009:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eac3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8009:1876028970515968:0@lo:502: 00000100:00100000:3.0:1789120769.440809:0:8009:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120769.440894:0:8009:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835dac00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120769.442934:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970515968 00000100:00100000:1.0:1789120769.442952:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970515968 00000100:00100000:1.0:1789120769.443025:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789120769.443426:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+17:8009:x1876028970515968:12345-0@lo:502: 00000100:00100000:1.0:1789120769.444779:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+17:8009:x1876028970515968:12345-0@lo:502: Request processed in 1350us (3960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120769.444800:0:8009:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eac3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8009:1876028970515968:0@lo:502: 00000020:01000000:3.0:1789120769.444876:0:8009:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120769.444899:0:8009:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120769.444902:0:8009:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789120769.444908:0:8009:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000100:00100000:1.0:1789120769.445350:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000020:01000000:0.0:1789120769.450720:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789120769.450775:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120769.450961:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a830f071 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120769.450979:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a830f071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120769.450994:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789120769.450998:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946886899000 from 1 10000000:01000000:0.0:1789120769.451001:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120769.451057:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120769.451066:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120769.451079:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120769.451110:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970516096:0@lo:101: 00000100:00100000:0.0:1789120769.451208:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120769.451271:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789120769.454009:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970516096 00000100:00100000:2.0:1789120769.454030:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970516096 00000100:00100000:2.0:1789120769.454123:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789120769.454136:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970516096:12345-0@lo:101: 00010000:00010000:2.0:1789120769.454160:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120769.454186:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a54000/0xb74d2367a830f086 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f07f expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.454221:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a54000/0xb74d2367a830f086 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f07f expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.454234:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a54000/0xb74d2367a830f086 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f07f expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.454244:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54000, rc 0) 00000100:00100000:0.0:1789120769.455894:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970516096:12345-0@lo:101: Request processed in 1742us (4668us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120769.455909:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789120769.456541:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c43c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970516096:0@lo:101: 00010000:00010000:1.0:1789120769.456577:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120769.456590:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120769.456692:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970516224:0@lo:501: 00000100:00100000:1.0:1789120769.456751:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120769.457130:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852cbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120769.459244:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970516224 00000100:00100000:3.0:1789120769.459264:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970516224 00000100:00100000:3.0:1789120769.459357:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789120769.459369:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970516224:12345-0@lo:501: 00000100:00100000:3.0:1789120769.459609:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970516224:12345-0@lo:501: Request processed in 241us (2857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120769.459619:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789120769.460023:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970516224:0@lo:501: 00000100:00100000:1.0:1789120769.460948:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970516352:0@lo:503: 00000100:00100000:1.0:1789120769.461101:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120769.461145:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852cbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120769.461330:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970516352 00000100:00100000:0.0:1789120769.461338:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970516352 00000100:00100000:0.0:1789120769.461399:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789120769.461410:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970516352:12345-0@lo:503: 00000100:00100000:0.0:1789120769.461610:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970516352:12345-0@lo:503: Request processed in 201us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120769.461625:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789120769.461782:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d21c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970516352:0@lo:503: 00000100:00100000:1.0:1789120769.462946:0:8011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8011:1876028970516480:0@lo:502: 00000100:00100000:1.0:1789120769.463286:0:8011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120769.463339:0:8011:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852cb900 going to sleep for 11 seconds 00000100:00100000:3.0:1789120769.464538:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970516480 00000100:00100000:3.0:1789120769.464552:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970516480 00000100:00100000:3.0:1789120769.464615:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789120769.464626:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:8011:x1876028970516480:12345-0@lo:502: 00000100:00100000:3.0:1789120769.464813:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:8011:x1876028970516480:12345-0@lo:502: Request processed in 188us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120769.464841:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789120769.464851:0:8011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d21c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8011:1876028970516480:0@lo:502: 00000020:01000000:0.0:1789120769.464898:0:8011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120769.464911:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120769.464914:0:8011:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789120769.464923:0:8011:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946886899000 00000020:00000080:0.0:1789120769.464926:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789120769.464963:0:8011:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8011:1876028970516608:0@lo:502: 00000100:00100000:0.0:1789120769.465019:0:8011:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120769.465119:0:8011:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120769.466361:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970516608 00000100:00100000:2.0:1789120769.466374:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970516608 00000100:00100000:2.0:1789120769.466435:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789120769.466445:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:8011:x1876028970516608:12345-0@lo:502: 00000100:00100000:2.0:1789120769.466595:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:8011:x1876028970516608:12345-0@lo:502: Request processed in 151us (1575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120769.466603:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789120769.466938:0:8011:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8011:1876028970516608:0@lo:502: 00000020:01000000:0.0:1789120769.466975:0:8011:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120769.466994:0:8011:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120769.466997:0:8011:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789120769.467002:0:8011:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789120769.467186:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789120769.467213:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120769.467225:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120769.468429:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120769.682098:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120770.453435:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970516736:0@lo:41: 00000100:00100000:1.0:1789120770.453556:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120770.453789:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970516736 00000100:00100000:3.0:1789120770.453799:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970516736 00000100:00100000:3.0:1789120770.453897:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789120770.453909:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970516736:12345-0@lo:41: 00000004:00000024:3.0:1789120770.453973:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:3.0:1789120770.454036:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970516736:12345-0@lo:41: Request processed in 130us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120770.454063:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789120770.457241:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970516864:0@lo:41: 00000100:00100000:1.0:1789120770.457362:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120770.457489:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970516736:0@lo:41: 00000100:00100000:3.0:1789120770.457726:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970516992:0@lo:400: 00000100:00100000:3.0:1789120770.457769:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120770.457808:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120770.457814:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970517120:0@lo:400: 00000100:00100000:3.0:1789120770.457863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120770.457905:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970516992 00000100:00100000:3.0:1789120770.457911:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970516992 00000100:00100000:3.0:1789120770.457958:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789120770.457968:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:3646:x1876028970516992:12345-0@lo:400: 00000100:00100000:3.0:1789120770.458022:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:3646:x1876028970516992:12345-0@lo:400: Request processed in 55us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120770.458029:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789120770.458070:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eac3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970516992:0@lo:400: 00000100:00100000:2.0:1789120770.458429:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970516864 00000100:00100000:2.0:1789120770.458435:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970516864 00000100:00100000:2.0:1789120770.458463:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789120770.458470:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970516864:12345-0@lo:41: 00000004:00000024:2.0:1789120770.458501:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:2.0:1789120770.458544:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970516864:12345-0@lo:41: Request processed in 74us (1182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120770.458551:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789120770.458624:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970517120 00000100:00100000:1.0:1789120770.458629:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970517120 00000100:00100000:1.0:1789120770.458665:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789120770.458673:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970517120:12345-0@lo:400: 00000100:00100000:1.0:1789120770.458727:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970517120:12345-0@lo:400: Request processed in 55us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120770.458733:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1789120770.458767:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468a2eae580 x1876028970517120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120770.458918:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970517120:0@lo:400: 00000100:00100000:1.0:1789120770.458957:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970516864:0@lo:41: 00000100:00100000:1.0:1789120770.458969:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120770.458976:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970517248:0@lo:400: 00000100:00100000:1.0:1789120770.459005:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120770.459033:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970517248 00000100:00100000:1.0:1789120770.459037:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970517248 00000100:00100000:1.0:1789120770.459060:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789120770.459066:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970517248:12345-0@lo:400: 00000100:00100000:1.0:1789120770.459102:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970517248:12345-0@lo:400: Request processed in 36us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120770.459128:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789120770.459160:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468a2eaed00 x1876028970517248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120786 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120770.459170:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970517248:0@lo:400: 00010000:00010000:3.0:1789120770.710928:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120771.732810:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120772.754325:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120773.778050:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120774.801999:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120775.570436:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970517504:0@lo:400: 00000100:00100000:3.0:1789120775.570541:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120775.570618:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120775.570624:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970517632:0@lo:400: 00000100:00100000:3.0:1789120775.571127:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120775.571193:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970517504 00000100:00100000:3.0:1789120775.571203:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970517504 00000100:00100000:3.0:1789120775.571278:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789120775.571290:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970517504:12345-0@lo:400: 00000100:00100000:3.0:1789120775.571361:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970517504:12345-0@lo:400: Request processed in 74us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120775.571369:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789120775.571402:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970517632 00000100:00100000:3.0:1789120775.571405:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970517632 00000100:00100000:3.0:1789120775.571429:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789120775.571436:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970517632:12345-0@lo:400: 00000100:00100000:3.0:1789120775.571471:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970517632:12345-0@lo:400: Request processed in 36us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120775.571478:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789120775.571528:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eada40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970517632:0@lo:400: 00010000:00080000:3.0:1789120775.571543:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468a2eae580 x1876028970517504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120775.571555:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970517504:0@lo:400: 00000100:00100000:2.0:1789120775.571950:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970517760:0@lo:400: 00000100:00100000:2.0:1789120775.572005:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120775.572049:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789120775.572057:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970517376:0@lo:400: 00000100:00100000:2.0:1789120775.572089:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120775.572117:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970517888:0@lo:400: 00000100:00100000:2.0:1789120775.572143:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120775.572174:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970517376 00000100:00100000:2.0:1789120775.572178:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970517376 00000100:00100000:2.0:1789120775.572214:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789120775.572221:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:3644:x1876028970517376:12345-0@lo:400: 00000100:00100000:2.0:1789120775.572257:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:3644:x1876028970517376:12345-0@lo:400: Request processed in 37us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120775.572264:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789120775.572311:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970517888 00000100:00100000:2.0:1789120775.572315:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970517888 00000100:00100000:2.0:1789120775.572337:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789120775.572344:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970517888:12345-0@lo:400: 00000100:00100000:2.0:1789120775.572377:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970517888:12345-0@lo:400: Request processed in 33us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120775.572384:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789120775.572413:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970517376:0@lo:400: 00000100:00100000:2.0:1789120775.572424:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970517888:0@lo:400: 00000100:00100000:3.0:1789120775.573336:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970517760 00000100:00100000:3.0:1789120775.573344:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970517760 00000100:00100000:3.0:1789120775.573386:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789120775.573395:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970517760:12345-0@lo:400: 00000100:00100000:3.0:1789120775.573459:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970517760:12345-0@lo:400: Request processed in 66us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120775.573465:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789120775.573508:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468a2ead2c0 x1876028970517760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120791 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120775.573522:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970517760:0@lo:400: 00000100:00100000:1.0:1789120775.579152:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970518144:0@lo:41: 00000100:00100000:1.0:1789120775.579257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120775.579316:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120775.579324:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970518016:0@lo:41: 00000100:00100000:1.0:1789120775.579349:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120775.579402:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970518144 00000100:00100000:1.0:1789120775.579411:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970518144 00000100:00100000:1.0:1789120775.579460:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970518016 00000100:00100000:1.0:1789120775.579463:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970518016 00000100:00100000:1.0:1789120775.579479:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789120775.579489:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970518144:12345-0@lo:41: 00000004:00000024:1.0:1789120775.579544:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1789120775.579604:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970518144:12345-0@lo:41: Request processed in 116us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120775.579612:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789120775.579634:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789120775.579640:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970518016:12345-0@lo:41: 00000004:00000024:1.0:1789120775.579658:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789120775.579685:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970518016:12345-0@lo:41: Request processed in 46us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120775.579691:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789120775.579740:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970518016:0@lo:41: 00000100:00100000:1.0:1789120775.579767:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970518144:0@lo:41: 00010000:00010000:3.0:1789120775.826023:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120776.853017:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120777.880308:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789120778.617493:0:8426:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789120778.617499:0:8426:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789120778.617501:0:8426:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789120778.618851:0:8426:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9468b9991000 00000020:01000004:1.0:1789120778.619465:0:8426:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789120778.619481:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789120778.619500:0:8426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9468c0874ed8) 00000020:00000080:1.0:1789120778.619520:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789120778.660323:0:8426:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789120778.660398:0:8426:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1789120778.684207:0:8426:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789120778.685234:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789120778.685252:0:8426:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789120778.685270:0:8426:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb74d2367a830f094 00000020:01000004:2.0:1789120778.685279:0:8426:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789120778.685703:0:8426:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789120778.685709:0:8426:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789120778.685718:0:8426:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789120778.685725:0:8426:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789120778.685742:0:8426:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff946882bf4ed8) 00000020:00000080:2.0:1789120778.685757:0:8426:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1789120778.699275:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120778.701511:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789120778.701523:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789120778.712650:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789120778.712676:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1789120778.714594:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1789120778.714614:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789120778.717214:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120778.718108:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789120778.718117:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789120778.732119:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789120778.732140:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789120778.778386:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120778.778737:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789120778.778746:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789120778.797927:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789120778.797970:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789120778.815250:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789120778.821509:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789120778.836083:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789120778.836368:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789120778.836376:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789120778.837209:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789120778.837218:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:1.0:1789120778.906502:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120778.928287:0:8426:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789120778.928555:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789120778.928563:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789120778.930994:0:8426:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789120778.931014:0:8426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789120778.938058:0:8426:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789120778.938099:0:8426:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:3.0:1789120778.938108:0:8426:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789120778.962306:0:8426:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789120778.962449:0:8426:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.132@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789120778.962454:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789120778.962456:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789120778.962457:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120778.962459:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120778.962460:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120778.962461:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120778.962463:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120778.962465:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120778.962466:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120778.962468:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120778.962469:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789120778.962474:0:8426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789120778.962477:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789120778.962479:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789120778.962480:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120778.962481:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120778.962482:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120778.962483:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120778.962485:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120778.962486:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120778.962487:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120778.962488:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120778.962495:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789120778.962530:0:8426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789120778.962556:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970518272:0@lo:253: 00000100:00100000:3.0:1789120778.962656:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120778.962729:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bba6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120778.962853:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970518272 00000100:00100000:2.0:1789120778.962864:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970518272 00000100:00100000:2.0:1789120778.962946:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789120778.962957:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:8426:x1876028970518272:12345-0@lo:253: 20000000:01000000:2.0:1789120778.963003:0:6513:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789120778.963009:0:6513:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1789120778.963016:0:6513:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1789120778.963020:0:6513:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789120778.963258:0:6513:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120778.963698:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789120778.963716:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789120778.963733:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789120778.963739:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789120778.963749:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789120778.963760:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789120778.963892:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789120778.963908:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.132@tcp 20000000:01000000:2.0:1789120778.963910:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:2.0:1789120778.963920:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789120778.963926:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789120778.963937:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789120778.963942:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:2.0:1789120778.963952:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789120778.963974:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789120778.963986:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789120778.963998:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789120778.964060:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1789120778.964069:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.132@tcp 20000000:01000000:2.0:1789120778.964070:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:2.0:1789120778.964080:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1789120778.964085:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789120778.964109:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1789120778.964114:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:2.0:1789120778.964124:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1789120778.964128:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789120778.964138:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1789120778.964149:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1789120778.964752:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1789120778.964767:0:6513:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.132@tcp 20000000:01000000:2.0:1789120778.964769:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:2.0:1789120778.964780:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1789120778.964785:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789120778.964806:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1789120778.964812:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:2.0:1789120778.965178:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1789120778.965188:0:6513:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789120778.965201:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1789120778.965214:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1789120778.965228:0:6513:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789120778.965231:0:6513:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789120778.965236:0:6513:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789120778.965291:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789120778.965294:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789120778.966112:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1789120778.966168:0:8445:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1789120778.966183:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1789120778.966437:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:3.0:1789120778.966462:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:3.0:1789120778.966478:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 20000000:01000000:3.0:1789120778.966495:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789120778.966497:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789120778.967542:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789120778.967757:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789120778.967779:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789120778.967802:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789120778.967815:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1789120778.967817:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789120778.968237:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1789120778.968265:0:8447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1789120778.968277:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:3.0:1789120778.968484:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:3.0:1789120778.968506:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:3.0:1789120778.968521:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:3.0:1789120778.968531:0:6513:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789120778.968532:0:6513:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789120778.969006:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 20 1->4: lustre sys.timeout 20000000:01000000:1.0:1789120778.969035:0:8448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 20 2->4: lustre sys.timeout 00000040:00080000:1.0:1789120778.969049:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1789120778.969305:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1789120778.969339:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1789120778.969357:0:6513:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:3.0:1789120778.969378:0:6513:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789120778.969402:0:6513:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.969424:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946887083200/0xb74d2367a830ef6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830ef67 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.969433:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946880030800/0xb74d2367a830efe5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830efde expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.969440:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a55a00/0xb74d2367a830f01d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f016 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.969447:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a55e00/0xb74d2367a830f039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f032 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.969463:0:6513:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946880031600/0xb74d2367a830f063 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f05c expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.969472:0:6513:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.969524:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946880031600/0xb74d2367a830f063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f05c expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.969541:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946880031600/0xb74d2367a830f063 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f05c expref: 18 pid: 6512 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120778.969558:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b1a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970518400:0@lo:104: 00000100:00100000:3.0:1789120778.969646:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120778.969707:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a55e00/0xb74d2367a830f039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f032 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.969716:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946899a55e00/0xb74d2367a830f039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f032 expref: 18 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120778.969725:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970518528:0@lo:104: 00000100:00100000:3.0:1789120778.969747:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120778.970084:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a55a00/0xb74d2367a830f01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f016 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.970093:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946899a55a00/0xb74d2367a830f01d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f016 expref: 18 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120778.970102:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b3840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970518656:0@lo:104: 00000100:00100000:3.0:1789120778.970130:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120778.970476:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946880030800/0xb74d2367a830efe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830efde expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.970485:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946880030800/0xb74d2367a830efe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830efde expref: 18 pid: 6512 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120778.970494:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970518784:0@lo:104: 00000100:00100000:3.0:1789120778.970519:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120778.970564:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970518400 00000100:00100000:2.0:1789120778.970574:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970518400 00000100:00100000:2.0:1789120778.970624:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970518528 00000100:00100000:2.0:1789120778.970627:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970518528 00000100:00100000:2.0:1789120778.970639:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970518656 00000100:00100000:2.0:1789120778.970641:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970518656 00000100:00100000:2.0:1789120778.970655:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789120778.970666:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+5:6513:x1876028970518400:12345-0@lo:104: 00010000:00010000:2.0:1789120778.970682:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a830f05c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.970841:0:6513:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946887083200/0xb74d2367a830ef6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830ef67 expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.970851:0:6513:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946887083200/0xb74d2367a830ef6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830ef67 expref: 18 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120778.970860:0:6513:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970518912:0@lo:104: 00000100:00100000:3.0:1789120778.970883:0:6513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120778.970894:0:6513:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bba0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120778.970922:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b1a40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970518400:0@lo:104: 00010000:00010000:2.0:1789120778.970987:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120778.970994:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+5:6513:x1876028970518400:12345-0@lo:104: Request processed in 330us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120778.971003:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789120778.971022:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970518784 00000100:00100000:2.0:1789120778.971026:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970518784 00000100:00100000:2.0:1789120778.971038:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970518912 00000100:00100000:2.0:1789120778.971040:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970518912 00000100:00100000:2.0:1789120778.971051:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789120778.971057:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+6:6513:x1876028970518528:12345-0@lo:104: 00010000:00010000:2.0:1789120778.971076:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120778.971163:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970518528:0@lo:104: 00010000:00010000:1.0:1789120778.971279:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789120778.971289:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a830f05c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.971298:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789120778.971302:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a830f05c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.971312:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a830f05c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120778.971320:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a830f05c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120778.971434:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789120778.971525:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a830f05c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.971547:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120778.971583:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a830f05c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.971590:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a830f05c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f063 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.971605:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120778.971609:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.971615:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946880030000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789120778.971618:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.971625:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120778.971632:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120778.971638:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789120778.971676:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970519040:0@lo:103: 00000100:00100000:3.0:1789120778.971713:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120778.971765:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970519040 00000100:00100000:3.0:1789120778.971769:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970519040 00010000:00010000:3.0:1789120778.971804:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946880031600/0xb74d2367a830f063 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f05c expref: 19 pid: 6512 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120778.971850:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789120778.971857:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+19:3644:x1876028970519040:12345-0@lo:103: 00010000:00010000:3.0:1789120778.971879:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120778.971886:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946880031600/0xb74d2367a830f063 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f05c expref: 19 pid: 6512 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.971899:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946880031600/0xb74d2367a830f063 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f05c expref: 19 pid: 6512 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.971917:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946880031600/0xb74d2367a830f063 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f05c expref: 19 pid: 6512 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.971932:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120778.971963:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+18:3644:x1876028970519040:12345-0@lo:103: Request processed in 106us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120778.971969:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789120778.972006:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970519040:0@lo:103: 00010000:00010000:2.0:1789120778.972139:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1789120778.972148:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+6:6513:x1876028970518528:12345-0@lo:104: Request processed in 1089us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120778.972155:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789120778.972173:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789120778.972181:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+5:6513:x1876028970518656:12345-0@lo:104: 00010000:00010000:2.0:1789120778.972191:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946899a55200/0xb74d2367a830f016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.972230:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120778.972235:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+5:6513:x1876028970518656:12345-0@lo:104: Request processed in 57us (2105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120778.972241:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789120778.972253:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789120778.972258:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:6513:x1876028970518784:12345-0@lo:104: 00010000:00010000:2.0:1789120778.972267:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830efde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.972293:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789120778.972297:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:6513:x1876028970518784:12345-0@lo:104: Request processed in 40us (1779us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120778.972303:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789120778.972315:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120778.972321:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:6513:x1876028970518912:12345-0@lo:104: 00010000:00010000:3.0:1789120778.972549:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789120778.972711:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830ef67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.972741:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789120778.972747:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b12c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:6513:x1876028970518912:12345-0@lo:104: Request processed in 427us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120778.972754:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120778.972787:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b3840 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970518656:0@lo:104: 00000100:00100000:2.0:1789120778.972809:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970518784:0@lo:104: 00000100:00100000:2.0:1789120778.972817:0:6513:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6513:1876028970518912:0@lo:104: 00010000:00010000:2.0:1789120778.972882:0:6513:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.973161:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789120778.973430:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a55200/0xb74d2367a830f016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973439:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55200 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789120778.973443:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a55200/0xb74d2367a830f016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973453:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a55200/0xb74d2367a830f016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120778.973460:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a55200/0xb74d2367a830f016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120778.973467:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789120778.973513:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a55200/0xb74d2367a830f016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973520:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120778.973536:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a55200/0xb74d2367a830f016 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973542:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a55200/0xb74d2367a830f016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f01d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973555:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120778.973558:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830ef67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973563:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789120778.973566:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830ef67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973572:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830ef67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120778.973577:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830ef67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120778.973582:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789120778.973593:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830ef67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973599:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120778.973615:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830ef67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973632:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830ef67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830ef6e expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973643:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120778.973645:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120778.973646:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120778.973664:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970519296:0@lo:103: 00000100:00100000:3.0:1789120778.973713:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120778.973776:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970519296 00000100:00100000:3.0:1789120778.973782:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970519296 00010000:00010000:3.0:1789120778.973883:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946887083200/0xb74d2367a830ef6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830ef67 expref: 18 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120778.973907:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789120778.973915:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+18:3646:x1876028970519296:12345-0@lo:103: 00010000:00010000:3.0:1789120778.973927:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120778.973932:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946887083200/0xb74d2367a830ef6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830ef67 expref: 18 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973941:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946887083200/0xb74d2367a830ef6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830ef67 expref: 18 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973958:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887083200/0xb74d2367a830ef6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830ef67 expref: 18 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.973972:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120778.974002:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+17:3646:x1876028970519296:12345-0@lo:103: Request processed in 88us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120778.974018:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789120778.974053:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970519296:0@lo:103: 00000100:00100000:3.0:1789120778.974068:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120778.974076:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970519168:0@lo:103: 00000100:00100000:3.0:1789120778.974099:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120778.974123:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970519168 00000100:00100000:3.0:1789120778.974127:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970519168 00010000:00010000:3.0:1789120778.974141:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a55a00/0xb74d2367a830f01d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f016 expref: 17 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120778.974158:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789120778.974164:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+17:3644:x1876028970519168:12345-0@lo:103: 00010000:00010000:3.0:1789120778.974171:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120778.974175:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a55a00/0xb74d2367a830f01d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f016 expref: 17 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.974183:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a55a00/0xb74d2367a830f01d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f016 expref: 17 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.974192:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55a00/0xb74d2367a830f01d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f016 expref: 17 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.974200:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120778.974225:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+16:3644:x1876028970519168:12345-0@lo:103: Request processed in 62us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120778.974231:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789120778.974253:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970519168:0@lo:103: 00010000:00010000:1.0:1789120778.974888:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.974897:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120778.974916:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f032 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.974923:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f039 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120778.974945:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120778.974947:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120778.974950:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120778.975061:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970519424:0@lo:103: 00000100:00100000:3.0:1789120778.975109:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120778.975196:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970519424 00000100:00100000:0.0:1789120778.975203:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970519424 00010000:00010000:0.0:1789120778.975229:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a55e00/0xb74d2367a830f039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f032 expref: 16 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120778.975260:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789120778.975267:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+16:3647:x1876028970519424:12345-0@lo:103: 00010000:00010000:0.0:1789120778.975278:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120778.975289:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a55e00/0xb74d2367a830f039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f032 expref: 16 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.975299:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a55e00/0xb74d2367a830f039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f032 expref: 16 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.975313:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55e00/0xb74d2367a830f039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f032 expref: 16 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120778.975342:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120778.975388:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+15:3647:x1876028970519424:12345-0@lo:103: Request processed in 121us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120778.975395:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789120778.975569:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970519424:0@lo:103: 00010000:00010000:2.0:1789120778.975712:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120778.975716:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120778.975718:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120778.975744:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830efde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.975753:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887082600 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789120778.975758:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830efde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.975767:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830efde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120778.975774:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830efde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120778.975780:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789120778.975970:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830efde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.975977:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789120778.976022:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970519552:0@lo:103: 00000100:00100000:1.0:1789120778.976063:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120778.976226:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830efde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.976234:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830efde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830efe5 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.976254:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120778.976256:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120778.976258:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120778.976542:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970519552 00000100:00100000:2.0:1789120778.976549:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970519552 00010000:00010000:2.0:1789120778.976577:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946880030800/0xb74d2367a830efe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830efde expref: 15 pid: 6512 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120778.976640:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789120778.976649:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+15:3644:x1876028970519552:12345-0@lo:103: 00010000:00010000:2.0:1789120778.976660:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120778.976666:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946880030800/0xb74d2367a830efe5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830efde expref: 15 pid: 6512 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.976692:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946880030800/0xb74d2367a830efe5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830efde expref: 15 pid: 6512 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.976709:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946880030800/0xb74d2367a830efe5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830efde expref: 15 pid: 6512 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.976728:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.976738:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.976756:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.976765:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.976772:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.976780:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.976786:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887082c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789120778.976802:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.976812:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.977068:0:6513:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.977087:0:6513:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789120778.977096:0:6513:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1789120778.977176:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.977186:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887082c00/0xb74d2367a830f0a2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.977203:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120778.977276:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835eec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+14:3644:x1876028970519552:12345-0@lo:103: Request processed in 629us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120778.977285:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789120778.977521:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970519552:0@lo:103: 00000100:00100000:3.0:1789120778.981626:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+13:8426:x1876028970518272:12345-0@lo:253: Request processed in 18656us (18956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120778.981646:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789120778.981782:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b3c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970518272:0@lo:253: 10000000:01000000:2.0:1789120778.981813:0:8426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789120778.981817:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789120778.981857:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789120778.981859:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789120778.981860:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789120778.981862:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789120778.981864:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789120778.981866:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789120778.981869:0:8426:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789120778.981872:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789120778.981874:0:8426:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789120778.981906:0:8426:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9468b9991000 from lustre-OST0000 10000000:01000000:2.0:1789120778.981951:0:8426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789120778.981955:0:8426:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789120778.981965:0:8426:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9468ab900000 local copy 10000000:01000000:2.0:1789120778.981970:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789120778.982019:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.982032:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.982059:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120778.982095:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970519680:0@lo:101: 00000100:00100000:2.0:1789120778.982145:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120778.982198:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120778.982462:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970519680 00000100:00100000:3.0:1789120778.982479:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970519680 00000100:00100000:3.0:1789120778.982536:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789120778.982546:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+13:8426:x1876028970519680:12345-0@lo:101: 00010000:00010000:3.0:1789120778.982563:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120778.982580:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887082600/0xb74d2367a830f0b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f0a9 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.982612:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887082600/0xb74d2367a830f0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f0a9 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.982624:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887082600/0xb74d2367a830f0b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f0a9 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.982636:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082600, rc 0) 00000100:00100000:3.0:1789120778.982686:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970519680:12345-0@lo:101: Request processed in 141us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120778.982693:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789120778.982857:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970519680:0@lo:101: 00010000:00010000:2.0:1789120778.982875:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.982884:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120778.982999:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970519808:0@lo:501: 00000100:00100000:2.0:1789120778.983031:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120778.983064:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120778.983427:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970519808 00000100:00100000:3.0:1789120778.983433:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970519808 00000100:00100000:0.0:1789120778.983573:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789120778.983584:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970519808:12345-0@lo:501: 00000100:00100000:0.0:1789120778.983692:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970519808:12345-0@lo:501: Request processed in 110us (660us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120778.983699:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789120778.983790:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970519808:0@lo:501: 10000000:01000000:2.0:1789120778.983839:0:8426:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789120778.983861:0:8426:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789120778.983868:0:8426:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.983878:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.983886:0:8426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.983930:0:8426:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789120778.983973:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9468b9991000 10000000:01000000:2.0:1789120778.983980:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789120778.983987:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789120778.983989:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789120778.983994:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 00010000:00010000:3.0:1789120778.983995:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:2.0:1789120778.983998:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789120778.984008:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.984016:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54800 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789120778.984020:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.984028:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120778.984035:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120778.984041:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789120778.984067:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.984073:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120778.984116:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.984123:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f0a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xb74d2367a830f0b0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.984136:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120778.984136:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.984138:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120778.984140:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120778.984143:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.984151:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120778.984170:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520064:0@lo:101: 00000100:00100000:0.0:1789120778.984190:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120778.984204:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970519936:0@lo:103: 00000100:00100000:2.0:1789120778.984205:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120778.984235:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120778.984239:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789120778.984288:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970519936 00000100:00100000:3.0:1789120778.984293:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970519936 00000100:00100000:3.0:1789120778.984343:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120778.984351:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+14:3644:x1876028970519936:12345-0@lo:103: 00010000:00010000:3.0:1789120778.984372:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120778.984389:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887082600/0xb74d2367a830f0b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f0a9 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.984406:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120778.984436:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+13:3644:x1876028970519936:12345-0@lo:103: Request processed in 87us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120778.984443:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789120778.984461:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970520064 00000100:00100000:3.0:1789120778.984464:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970520064 00000100:00100000:3.0:1789120778.984503:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789120778.984509:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+13:8426:x1876028970520064:12345-0@lo:101: 00010000:00010000:3.0:1789120778.984517:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120778.984529:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887083200/0xb74d2367a830f0be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f0b7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.984550:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887083200/0xb74d2367a830f0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f0b7 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.984561:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887083200/0xb74d2367a830f0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f0b7 expref: 14 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120778.984568:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887083200, rc 0) 00000100:00100000:3.0:1789120778.984592:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970520064:12345-0@lo:101: Request processed in 83us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120778.984596:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789120778.984626:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970519936:0@lo:103: 00000100:00100000:2.0:1789120778.985407:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520064:0@lo:101: 00010000:00010000:2.0:1789120778.985425:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120778.985435:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120778.985532:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520192:0@lo:501: 00000100:00100000:2.0:1789120778.985584:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120778.985625:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789120778.986441:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970520192 00000100:00100000:3.0:1789120778.986460:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970520192 00000100:00100000:3.0:1789120778.986511:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789120778.986521:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970520192:12345-0@lo:501: 00000100:00100000:3.0:1789120778.986675:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970520192:12345-0@lo:501: Request processed in 156us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120778.986682:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789120778.986936:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520192:0@lo:501: 00000100:00100000:2.0:1789120778.986991:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520320:0@lo:503: 00000100:00100000:2.0:1789120778.987052:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120778.987125:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120778.988208:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970520320 00000100:00100000:0.0:1789120778.988219:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970520320 00000100:00100000:0.0:1789120778.988328:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789120778.988339:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970520320:12345-0@lo:503: 00000100:00100000:0.0:1789120778.988524:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970520320:12345-0@lo:503: Request processed in 186us (1471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120778.988532:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789120778.988598:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520320:0@lo:503: 00000040:00080000:3.0:1789120778.988997:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120778.989106:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520448:0@lo:502: 00000100:00100000:3.0:1789120778.989158:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120778.989249:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bba540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120778.989290:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970520448 00000100:00100000:2.0:1789120778.989296:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970520448 00000100:00100000:2.0:1789120778.989526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789120778.989538:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970520448:12345-0@lo:502: 00000100:00100000:2.0:1789120778.989657:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970520448:12345-0@lo:502: Request processed in 122us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120778.989665:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789120778.989758:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520448:0@lo:502: 00000040:00080000:0.0:1789120778.990396:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789120778.990436:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1789120778.990449:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1789120778.990461:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1789120778.990574:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1789120778.990592:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1789120778.990632:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520576:0@lo:502: 00000100:00100000:0.0:1789120778.990695:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120778.990749:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946781089600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120778.990945:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970520576 00000100:00100000:2.0:1789120778.990953:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970520576 00000100:00100000:2.0:1789120778.991006:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789120778.991016:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970520576:12345-0@lo:502: 00000100:00100000:2.0:1789120778.991130:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970520576:12345-0@lo:502: Request processed in 114us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120778.991138:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789120778.991152:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520576:0@lo:502: 00000040:00080000:0.0:1789120778.991198:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789120778.991208:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1789120778.991813:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789120778.991846:0:8451:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789120778.991855:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120778.991858:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789120778.991866:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789120778.991892:0:8451:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9467821eced8) 00000020:00000080:0.0:1789120778.991920:0:8451:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789120778.991927:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789120778.992082:0:8451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468b9991000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789120778.992093:0:8451:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789120778.992100:0:8451:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb74d2367a830f0cc 00010000:00010000:1.0:1789120778.995679:0:8451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:1.0:1789120778.996166:0:8451:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789120779.002547:0:8451:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789120779.003134:0:8451:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1789120779.017684:0:8451:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1789120779.018228:0:8451:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789120779.030494:0:8451:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1789120779.038599:0:8451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789120779.038621:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120779.038630:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120779.038632:0:8451:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789120779.038636:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120779.038640:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120779.038642:0:8451:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789120779.038645:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789120779.038647:0:8451:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789120779.038665:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120779.038667:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120779.038668:0:8451:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789120779.038671:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789120779.040518:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1789120779.040591:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789120779.040625:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120779.040656:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120779.040667:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468b9991000 from 1 10000000:01000000:0.0:1789120779.040670:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120779.040727:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120779.040735:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120779.040750:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120779.040786:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520704:0@lo:101: 00000100:00100000:0.0:1789120779.040923:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120779.041014:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467810899c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120779.041623:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970520704 00000100:00100000:1.0:1789120779.041635:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970520704 00000100:00100000:1.0:1789120779.041704:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789120779.041716:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970520704:12345-0@lo:101: 00010000:00010000:1.0:1789120779.041736:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120779.041757:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f0da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f0d3 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120779.041789:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f0da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f0d3 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120779.041813:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f0da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f0d3 expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120779.041869:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f10000, rc 0) 00000100:00100000:1.0:1789120779.041934:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:8426:x1876028970520704:12345-0@lo:101: Request processed in 220us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120779.041941:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789120779.043019:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520704:0@lo:101: 00010000:00010000:0.0:1789120779.043047:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120779.043057:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120779.043209:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520832:0@lo:501: 00000100:00100000:0.0:1789120779.043279:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120779.043327:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467810899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120779.043360:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970520832 00000100:00100000:0.0:1789120779.043366:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970520832 00000100:00100000:0.0:1789120779.043406:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789120779.043414:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:8426:x1876028970520832:12345-0@lo:501: 00000100:00100000:0.0:1789120779.043557:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:8426:x1876028970520832:12345-0@lo:501: Request processed in 143us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.043565:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789120779.043598:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520832:0@lo:501: 00000100:00100000:0.0:1789120779.043623:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520960:0@lo:503: 00000100:00100000:0.0:1789120779.043658:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120779.043670:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467810899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120779.043684:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970520960 00000100:00100000:0.0:1789120779.043688:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970520960 00000100:00100000:0.0:1789120779.043706:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789120779.043711:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:8426:x1876028970520960:12345-0@lo:503: 00000100:00100000:0.0:1789120779.043784:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:8426:x1876028970520960:12345-0@lo:503: Request processed in 72us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.043789:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789120779.043864:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970520960:0@lo:503: 00000040:00080000:0.0:1789120779.044138:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789120779.044212:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521088:0@lo:502: 00000100:00100000:0.0:1789120779.044253:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120779.044287:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467810899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120779.044303:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970521088 00000100:00100000:0.0:1789120779.044306:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970521088 00000100:00100000:0.0:1789120779.044325:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789120779.044331:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:8426:x1876028970521088:12345-0@lo:502: 00000100:00100000:0.0:1789120779.044417:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:8426:x1876028970521088:12345-0@lo:502: Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.044424:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789120779.044463:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521088:0@lo:502: 00000040:00080000:0.0:1789120779.044679:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789120779.044706:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789120779.044728:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521216:0@lo:502: 00000100:00100000:0.0:1789120779.044764:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120779.044780:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467810899c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120779.044809:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970521216 00000100:00100000:0.0:1789120779.044813:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970521216 00000100:00100000:0.0:1789120779.044862:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789120779.044868:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:8426:x1876028970521216:12345-0@lo:502: 00000100:00100000:0.0:1789120779.044934:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:8426:x1876028970521216:12345-0@lo:502: Request processed in 66us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.044941:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789120779.044979:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521216:0@lo:502: 00000040:00080000:0.0:1789120779.045015:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789120779.045023:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789120779.045341:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120779.045351:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120779.045354:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789120779.045360:0:8455:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9468b9991000 00000020:00000080:0.0:1789120779.045363:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789120779.045375:0:8455:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120779.045377:0:8455:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120779.045379:0:8455:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789120779.045382:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789120779.045416:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789120779.045437:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120779.045452:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120779.045463:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120779.045514:0:8426:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789120779.045518:0:8426:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9468b9991000 10000000:01000000:0.0:1789120779.045523:0:8426:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9468b9991000 10000000:01000000:0.0:1789120779.045527:0:8426:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789120779.045535:0:8426:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9468b9991000 from 1 10000000:01000000:0.0:1789120779.045537:0:8426:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789120779.045569:0:8426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120779.045576:0:8426:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120779.045587:0:8426:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120779.045602:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521344:0@lo:101: 00000100:00100000:0.0:1789120779.045642:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120779.045672:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946781089180 going to sleep for 11 seconds 00000100:00100000:0.0:1789120779.045690:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970521344 00000100:00100000:0.0:1789120779.045695:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970521344 00000100:00100000:0.0:1789120779.045717:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789120779.045724:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:8426:x1876028970521344:12345-0@lo:101: 00010000:00010000:0.0:1789120779.045743:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120779.045758:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946880030a00/0xb74d2367a830f0e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f0e1 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120779.045785:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946880030a00/0xb74d2367a830f0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f0e1 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120779.054874:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946880030a00/0xb74d2367a830f0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f0e1 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120779.054897:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946880030a00, rc 0) 00000100:00100000:0.0:1789120779.055101:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:8426:x1876028970521344:12345-0@lo:101: Request processed in 9373us (9454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.055111:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789120779.055288:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521344:0@lo:101: 00010000:00010000:2.0:1789120779.055318:0:8426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.055329:0:8426:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120779.055520:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521472:0@lo:501: 00000100:00100000:2.0:1789120779.055574:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120779.055628:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789120779.055873:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970521472 00000100:00100000:3.0:1789120779.055882:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970521472 00000100:00100000:3.0:1789120779.055938:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789120779.055949:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:8426:x1876028970521472:12345-0@lo:501: 00000100:00100000:3.0:1789120779.056110:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:8426:x1876028970521472:12345-0@lo:501: Request processed in 163us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120779.056125:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789120779.056239:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521472:0@lo:501: 00000100:00100000:2.0:1789120779.056279:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521600:0@lo:503: 00000100:00100000:2.0:1789120779.056328:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120779.062113:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a600 going to sleep for 11 seconds 00000100:00100000:0.0:1789120779.062873:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970521600 00000100:00100000:0.0:1789120779.062889:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970521600 00000100:00100000:0.0:1789120779.063077:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789120779.063089:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:8426:x1876028970521600:12345-0@lo:503: 00000100:00100000:0.0:1789120779.063387:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:8426:x1876028970521600:12345-0@lo:503: Request processed in 299us (7058us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.063396:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789120779.066922:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521600:0@lo:503: 00000040:00080000:2.0:1789120779.067411:0:8426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120779.069442:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521728:0@lo:502: 00000100:00100000:3.0:1789120779.069580:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120779.069643:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bba0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120779.070261:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970521728 00000100:00100000:1.0:1789120779.070272:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970521728 00000100:00100000:1.0:1789120779.070359:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789120779.070371:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:8426:x1876028970521728:12345-0@lo:502: 00000100:00100000:1.0:1789120779.070603:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:8426:x1876028970521728:12345-0@lo:502: Request processed in 233us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120779.070611:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789120779.070648:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521728:0@lo:502: 00000040:00080000:3.0:1789120779.071028:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789120779.071066:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789120779.071081:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789120779.071096:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789120779.071110:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789120779.071124:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789120779.071138:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789120779.071153:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789120779.071168:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789120779.071181:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789120779.071195:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789120779.071208:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789120779.071221:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789120779.071236:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789120779.071251:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789120779.071265:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789120779.071280:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789120779.071294:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789120779.071308:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789120779.071322:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789120779.071335:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789120779.071350:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789120779.071365:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789120779.071380:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789120779.071394:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789120779.071422:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789120779.071439:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789120779.071471:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789120779.071488:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789120779.071502:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789120779.071515:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789120779.071528:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789120779.071540:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789120779.071555:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789120779.071568:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789120779.071582:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789120779.071595:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1789120779.071636:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521856:0@lo:502: 00000100:00100000:3.0:1789120779.071702:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120779.071762:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff946898737540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120779.071771:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970521856 00000100:00100000:2.0:1789120779.071777:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970521856 00000100:00100000:2.0:1789120779.071866:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789120779.071878:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:8426:x1876028970521856:12345-0@lo:502: 00000100:00100000:2.0:1789120779.072006:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:8426:x1876028970521856:12345-0@lo:502: Request processed in 130us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120779.072014:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789120779.072549:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b1a40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970521856:0@lo:502: 00000040:00080000:3.0:1789120779.072613:0:8426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789120779.072626:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1789120779.082423:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789120779.082481:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff946782859a48) 00000020:00000080:1.0:1789120779.082515:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789120779.082645:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468b9991000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789120779.082650:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468b9991000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789120779.082653:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468b9991000 3 00010000:00080000:1.0:1789120779.082696:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94689df21800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789120779.084408:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:1.0:1789120779.084851:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789120779.084904:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789120779.084920:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb74d2367a830f0f6 00000100:00080000:1.0:1789120779.084933:0:8456:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789120779.084939:0:8456:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94689df21800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789120779.084988:0:8456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99d0780 x1876028970521984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789120779.085682:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789120779.085993:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970522240:0@lo:400: 00000100:00100000:0.0:1789120779.086095:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120779.086157:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120779.086163:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970522112:0@lo:400: 00000100:00100000:0.0:1789120779.086193:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120779.086226:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970522368:0@lo:400: 00000100:00100000:0.0:1789120779.086271:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120779.086293:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120779.086298:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970522496:0@lo:400: 00000100:00100000:0.0:1789120779.086326:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120779.086373:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970522240 00000100:00100000:0.0:1789120779.086382:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970522240 00000100:00100000:0.0:1789120779.086421:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970522496 00000100:00100000:0.0:1789120779.086423:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970522496 00000100:00100000:0.0:1789120779.086439:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789120779.086448:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970522240:12345-0@lo:400: 00000100:00100000:0.0:1789120779.086529:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970522240:12345-0@lo:400: Request processed in 81us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.086537:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789120779.086557:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789120779.086563:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970522496:12345-0@lo:400: 00000100:00100000:0.0:1789120779.086595:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970522496:12345-0@lo:400: Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.086602:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789120779.086621:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970522112 00000100:00100000:0.0:1789120779.086624:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970522112 00000100:00100000:0.0:1789120779.086650:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970522368 00000100:00100000:0.0:1789120779.086653:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970522368 00000100:00100000:0.0:1789120779.086665:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789120779.086671:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970522112:12345-0@lo:400: 00000100:00100000:0.0:1789120779.086699:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970522112:12345-0@lo:400: Request processed in 28us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.086704:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789120779.086713:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789120779.086727:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970522368:12345-0@lo:400: 00000100:00100000:0.0:1789120779.086754:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970522368:12345-0@lo:400: Request processed in 28us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.086759:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789120779.086858:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970522496:0@lo:400: 00010000:00080000:0.0:1789120779.086875:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468b99c52c0 x1876028970522368/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120779.086884:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970522368:0@lo:400: 00010000:00080000:0.0:1789120779.087056:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468b99c6940 x1876028970522112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120779.087066:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970522112:0@lo:400: 00000100:00100000:0.0:1789120779.087074:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970522240:0@lo:400: 00000100:00100000:3.0:1789120779.087433:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970521984:0@lo:38: 00000100:00100000:3.0:1789120779.087496:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120779.087955:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970521984 00000100:00100000:0.0:1789120779.087963:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970521984 00000100:00100000:0.0:1789120779.088005:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789120779.088011:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876028970521984:12345-0@lo:38: 00010000:00080000:0.0:1789120779.088043:0:6520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:0.0:1789120779.088088:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb74d2367a830f0fd 00000004:00100000:0.0:1789120779.088111:0:6520:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789120779.088155:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9467821dc800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789120779.088214:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876028970521984:12345-0@lo:38: Request processed in 201us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.088221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789120779.088376:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468b99d0780 x1876028970521984/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120779.088387:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789120779.088395:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789120779.088405:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789120779.088411:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789120779.088413:0:3643:0:(import.c:65:import_set_state_nolock()) ffff94689df21800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789120779.088420:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970521984:0@lo:38: 00000020:01000004:1.0:1789120779.088709:0:8456:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789120779.088730:0:8456:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff94678285b490) 00000020:00000080:1.0:1789120779.088753:0:8456:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:1.0:1789120779.088907:0:8456:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468b9991000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789120779.088913:0:8456:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468b9991000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789120779.088916:0:8456:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468b9991000 3 00010000:00080000:1.0:1789120779.088960:0:8456:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94689df20000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789120779.091262:0:8456:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:1.0:1789120779.091500:0:8456:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1789120779.091554:0:8456:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789120779.091578:0:8456:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb74d2367a830f10b 00000100:00080000:1.0:1789120779.091592:0:8456:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789120779.091600:0:8456:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff94689df20000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789120779.091650:0:8456:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99d0000 x1876028970522624/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789120779.091675:0:8456:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789120779.092147:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876028970522624:0@lo:38: 00000100:00100000:3.0:1789120779.092250:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120779.102177:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970522624 00000100:00100000:1.0:1789120779.102200:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970522624 00000100:00100000:1.0:1789120779.102272:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789120779.102283:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876028970522624:12345-0@lo:38: 00010000:00080000:1.0:1789120779.102325:0:6519:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:1.0:1789120779.102368:0:6519:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb74d2367a830f112 00000004:00100000:1.0:1789120779.102389:0:6519:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789120779.102434:0:6519:0:(import.c:65:import_set_state_nolock()) ffff946782ae8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120779.102574:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876028970522624:12345-0@lo:38: Request processed in 292us (10324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120779.102594:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1789120779.102729:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789120779.102818:0:8426:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789120779.102876:0:8426:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789120779.102894:0:8426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120779.102906:0:8426:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789120779.102964:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789120779.102967:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789120779.102969:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120779.102970:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120779.102971:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120779.102973:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120779.102975:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120779.102977:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120779.102978:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120779.102980:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120779.102982:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789120779.102988:0:8426:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1789120779.102991:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789120779.102992:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789120779.102993:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120779.102994:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120779.102995:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120779.102996:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120779.102998:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120779.102999:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120779.103000:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120779.103001:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120779.103002:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789120779.103029:0:8426:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789120779.103049:0:8426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970522752:0@lo:253: 00000100:00100000:3.0:1789120779.103112:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120779.103148:0:8426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468987376c0 going to sleep for 11 seconds 00010000:00080000:2.0:1789120779.107595:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468b99d0000 x1876028970522624/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120779.107618:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789120779.107632:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789120779.107645:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789120779.107652:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789120779.107657:0:3643:0:(import.c:65:import_set_state_nolock()) ffff94689df20000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789120779.107666:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876028970522624:0@lo:38: 00000100:00100000:2.0:1789120779.107760:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970522752 00000100:00100000:2.0:1789120779.107770:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970522752 00000100:00100000:2.0:1789120779.107897:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789120779.107911:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:8426:x1876028970522752:12345-0@lo:253: 20000000:01000000:2.0:1789120779.107957:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789120779.107978:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789120779.126806:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789120779.126968:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789120779.127109:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789120779.127117:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789120779.127151:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.127180:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946887083e00/0xb74d2367a830f00f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f008 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.127190:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a54e00/0xb74d2367a830f02b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f024 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.127197:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.127259:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a54e00/0xb74d2367a830f02b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f024 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.127279:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946899a54e00/0xb74d2367a830f02b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f024 expref: 16 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120779.127296:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970522880:0@lo:104: 00000100:00100000:2.0:1789120779.127353:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120779.127453:0:8426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:8426:1876028970522752:0@lo:253: 10000000:01000000:3.0:1789120779.127481:0:8426:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789120779.127485:0:8426:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789120779.127487:0:8426:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789120779.127488:0:8426:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789120779.127489:0:8426:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789120779.127490:0:8426:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789120779.127492:0:8426:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789120779.127493:0:8426:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789120779.127495:0:8426:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789120779.127497:0:8426:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789120779.127498:0:8426:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789120779.127500:0:8426:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789120779.127522:0:8426:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789120779.138672:0:8426:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00010000:00010000:2.0:1789120779.139093:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946887083e00/0xb74d2367a830f00f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f008 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.139123:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946887083e00/0xb74d2367a830f00f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f008 expref: 16 pid: 6513 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120779.139139:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970523008:0@lo:104: 00000100:00100000:2.0:1789120779.139310:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120779.139362:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789120779.139393:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120779.139424:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970522880 00000100:00100000:2.0:1789120779.139433:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970522880 00000100:00100000:2.0:1789120779.139492:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970523008 00000100:00100000:2.0:1789120779.139496:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970523008 00000100:00100000:2.0:1789120779.139512:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789120779.139522:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9988450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:6534:x1876028970522880:12345-0@lo:104: 00010000:00010000:2.0:1789120779.139538:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.139596:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120779.139602:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9988450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:6534:x1876028970522880:12345-0@lo:104: Request processed in 82us (12250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120779.139611:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789120779.139651:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120779.139658:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:6534:x1876028970523008:12345-0@lo:104: 00010000:00010000:2.0:1789120779.139666:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946899a54a00/0xb74d2367a830f008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.139698:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789120779.139704:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:6534:x1876028970523008:12345-0@lo:104: Request processed in 47us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120779.139719:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1789120779.139744:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789120779.139752:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.139761:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946880030e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120779.139766:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.139776:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120779.139783:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120779.139789:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120779.140724:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.140734:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120779.140768:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f024 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.140775:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f02b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.140804:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120779.140808:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a54a00/0xb74d2367a830f008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.140845:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54a00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120779.140848:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a54a00/0xb74d2367a830f008 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.140855:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a54a00/0xb74d2367a830f008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120779.140861:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a54a00/0xb74d2367a830f008 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120779.140866:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120779.140881:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a54a00/0xb74d2367a830f008 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.140886:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120779.140892:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a54a00/0xb74d2367a830f008 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.140898:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a54a00/0xb74d2367a830f008 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f00f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.140913:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120779.140915:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120779.140918:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120779.140952:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946889573840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970523136:0@lo:103: 00000100:00100000:2.0:1789120779.141021:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120779.141058:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120779.141063:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893846d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970523264:0@lo:103: 00000100:00100000:2.0:1789120779.141091:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120779.141124:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970523136 00000100:00100000:2.0:1789120779.141130:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970523136 00010000:00010000:2.0:1789120779.141157:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a54e00/0xb74d2367a830f02b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f024 expref: 17 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789120779.141685:0:8426:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:2.0:1789120779.142258:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970523264 00000100:00100000:2.0:1789120779.142267:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970523264 00010000:00010000:2.0:1789120779.142294:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946887083e00/0xb74d2367a830f00f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f008 expref: 18 pid: 6513 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120779.142314:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789120779.142323:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893846940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+18:3646:x1876028970523136:12345-0@lo:103: 00010000:00010000:2.0:1789120779.142340:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120779.142345:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a54e00/0xb74d2367a830f02b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f024 expref: 18 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.142358:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a54e00/0xb74d2367a830f02b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f024 expref: 18 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.142381:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120779.142448:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893846940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+18:3646:x1876028970523136:12345-0@lo:103: Request processed in 126us (1427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120779.142458:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789120779.143135:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120779.143145:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+17:3646:x1876028970523264:12345-0@lo:103: 00010000:00010000:2.0:1789120779.143155:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120779.143162:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946887083e00/0xb74d2367a830f00f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f008 expref: 17 pid: 6513 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1789120779.143315:0:8426:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00010000:00010000:2.0:1789120779.143374:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946887083e00/0xb74d2367a830f00f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f008 expref: 17 pid: 6513 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143394:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143403:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789120779.143424:0:6505:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016309101s 00010000:00010000:2.0:1789120779.143430:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143438:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143444:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143450:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143457:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789120779.143461:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143486:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143496:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143517:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120779.143569:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938461c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+17:3646:x1876028970523264:12345-0@lo:103: Request processed in 426us (2476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120779.143576:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120779.143637:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893846d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970523264:0@lo:103: 00000100:00100000:2.0:1789120779.143647:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946889573840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970523136:0@lo:103: 00010000:00010000:2.0:1789120779.143812:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a54e00/0xb74d2367a830f02b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f024 expref: 16 pid: 6510 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120779.143845:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970522880:0@lo:104: 00010000:00010000:2.0:1789120779.143856:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887083e00/0xb74d2367a830f00f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f008 expref: 15 pid: 6513 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120779.143864:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970523008:0@lo:104: 00010000:00010000:2.0:1789120779.143880:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143888:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143894:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143899:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a54200/0xb74d2367a830f119 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120779.143926:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1789120779.144412:0:8426:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1789120779.145225:0:8426:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:3.0:1789120779.145413:0:8426:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000100:00100000:0.0:1789120779.146576:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+14:8426:x1876028970522752:12345-0@lo:253: Request processed in 38651us (43447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120779.146594:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000001:00000004:0.0:1789120779.149204:0:8426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789120779.161699:0:8426:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1789120779.161713:0:8426:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1789120779.161767:0:8426:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789120779.161900:0:8426:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789120779.161922:0:8426:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789120779.163222:0:8426:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:0.0:1789120779.171360:0:8426:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789120779.171615:0:8426:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:3.0:1789120779.921944:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789120780.391656:0:8512:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789120780.392080:0:8512:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789120780.690030:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970523392:0@lo:41: 00000100:00100000:0.0:1789120780.690138:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120780.690235:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120780.690242:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970523520:0@lo:41: 00000100:00100000:0.0:1789120780.690267:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120780.690315:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970523392 00000100:00100000:0.0:1789120780.690324:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970523392 00000100:00100000:0.0:1789120780.690375:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970523520 00000100:00100000:0.0:1789120780.690379:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970523520 00000100:00100000:0.0:1789120780.690399:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789120780.690409:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970523392:12345-0@lo:41: 00000004:00000024:0.0:1789120780.690529:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:0.0:1789120780.690599:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970523392:12345-0@lo:41: Request processed in 191us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120780.690609:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789120780.690631:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789120780.690639:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970523520:12345-0@lo:41: 00000100:00100000:2.0:1789120780.690648:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970523392:0@lo:41: 00000004:00000024:0.0:1789120780.690659:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1789120780.690717:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970523520:12345-0@lo:41: Request processed in 79us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120780.690724:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789120780.690743:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970523520:0@lo:41: 00010000:00010000:1.0:1789120780.953731:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120781.972340:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120782.995167:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120784.017971:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120784.277027:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970523648:0@lo:400: 00000100:00100000:1.0:1789120784.277137:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120784.279479:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970523648 00000100:00100000:0.0:1789120784.279499:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970523648 00000100:00100000:0.0:1789120784.279593:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789120784.279606:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+14:3646:x1876028970523648:12345-0@lo:400: 00000100:00100000:3.0:1789120784.281810:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970523904:0@lo:400: 00000100:00100000:3.0:1789120784.281949:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120784.281997:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970524416:0@lo:400: 00000100:00100000:3.0:1789120784.282027:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120784.282071:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120784.282077:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970524032:0@lo:400: 00000100:00100000:3.0:1789120784.282128:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120784.282171:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970523904 00000100:00100000:3.0:1789120784.282180:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970523904 00000100:00100000:3.0:1789120784.282239:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789120784.282249:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970523904:12345-0@lo:400: 00000100:00100000:0.0:1789120784.282455:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+14:3646:x1876028970523648:12345-0@lo:400: Request processed in 2847us (5314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120784.282467:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789120784.282885:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970523776:0@lo:400: 00000100:00100000:0.0:1789120784.282922:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120784.282945:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970524288:0@lo:400: 00000100:00100000:0.0:1789120784.282971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120784.282986:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120784.282992:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970524160:0@lo:400: 00000100:00100000:0.0:1789120784.283016:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120784.283039:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970524416 00000100:00100000:0.0:1789120784.283044:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970524416 00000100:00100000:0.0:1789120784.283085:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970524032 00000100:00100000:0.0:1789120784.283088:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970524032 00000100:00100000:0.0:1789120784.283100:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970523776 00000100:00100000:0.0:1789120784.283101:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970523776 00000100:00100000:0.0:1789120784.283111:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970524288 00000100:00100000:0.0:1789120784.283114:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970524288 00000100:00100000:0.0:1789120784.283127:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789120784.283134:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970524416:12345-0@lo:400: 00000100:00100000:0.0:1789120784.283173:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970524416:12345-0@lo:400: Request processed in 39us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120784.283192:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789120784.283206:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120784.283212:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970524032:12345-0@lo:400: 00000100:00100000:0.0:1789120784.283244:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970524032:12345-0@lo:400: Request processed in 31us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120784.283250:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120784.283262:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789120784.283268:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970523776:12345-0@lo:400: 00000100:00100000:0.0:1789120784.283301:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970523776:12345-0@lo:400: Request processed in 33us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120784.283307:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789120784.283420:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970523904:12345-0@lo:400: Request processed in 65us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120784.283430:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789120784.283451:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970524160 00000100:00100000:3.0:1789120784.283455:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970524160 00000100:00100000:3.0:1789120784.283470:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789120784.283476:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970524160:12345-0@lo:400: 00000100:00100000:3.0:1789120784.283510:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970524160:12345-0@lo:400: Request processed in 34us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120784.283515:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789120784.283538:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789120784.283545:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970524288:12345-0@lo:400: 00000100:00100000:3.0:1789120784.283575:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970524288:12345-0@lo:400: Request processed in 31us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120784.283581:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789120784.283610:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789120784.283615:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1789120784.283650:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b30c0 x1876028970524032/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120784.283668:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970524032:0@lo:400: 00000100:00100000:3.0:1789120784.283683:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970523904:0@lo:400: 00010000:00080000:3.0:1789120784.283706:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b0b40 x1876028970524416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120784.283714:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970524416:0@lo:400: 00000100:00100000:0.0:1789120784.284473:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970524160:0@lo:400: 00010000:00080000:0.0:1789120784.284487:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b03c0 x1876028970523776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120784.284496:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970523776:0@lo:400: 00010000:00080000:0.0:1789120784.284505:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b12c0 x1876028970524288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120784.284512:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970524288:0@lo:400: 00000100:00100000:1.0:1789120784.284664:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970523648:0@lo:400: 00010000:00010000:2.0:1789120785.042146:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789120785.596705:0:8802:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789120785.810425:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970524544:0@lo:41: 00000100:00100000:0.0:1789120785.810524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120785.810690:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120785.810702:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970524672:0@lo:41: 00000100:00100000:1.0:1789120785.810746:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120785.810784:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970524544 00000100:00100000:1.0:1789120785.810793:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970524544 00000100:00100000:1.0:1789120785.810857:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970524672 00000100:00100000:1.0:1789120785.810861:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970524672 00000100:00100000:1.0:1789120785.810892:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789120785.810903:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970524544:12345-0@lo:41: 00000004:00000024:1.0:1789120785.810946:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:1.0:1789120785.810995:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970524544:12345-0@lo:41: Request processed in 93us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120785.811003:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789120785.811022:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789120785.811028:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970524672:12345-0@lo:41: 00000004:00000024:1.0:1789120785.811044:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:1.0:1789120785.811072:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970524672:12345-0@lo:41: Request processed in 44us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120785.811284:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789120785.811336:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970524672:0@lo:41: 00000100:00100000:1.0:1789120785.811373:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938452c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970524544:0@lo:41: 00010000:00010000:0.0:1789120786.070193:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789120786.379982:0:8854:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789120786.380210:0:8854:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789120787.091096:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789120787.346027:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789120787.346040:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946883582800 from 30 10000000:01000000:2.0:1789120787.346048:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789120787.346118:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.346132:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.346144:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120787.346178:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970524800:0@lo:101: 00000100:00100000:2.0:1789120787.346284:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120787.346396:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8600 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.346766:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970524800 00000100:00100000:0.0:1789120787.346776:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970524800 00000100:00100000:0.0:1789120787.346903:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789120787.346933:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+14:6515:x1876028970524800:12345-0@lo:101: 00010000:00010000:0.0:1789120787.346951:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120787.346967:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946880030400/0xb74d2367a830f127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f120 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.346996:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946880030400/0xb74d2367a830f127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f120 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.347009:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946880030400/0xb74d2367a830f127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f120 expref: 15 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.347019:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946880030400, rc 0) 00000100:00100000:0.0:1789120787.347081:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970524800:12345-0@lo:101: Request processed in 151us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.347089:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789120787.347415:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970524800:0@lo:101: 00010000:00010000:2.0:1789120787.347435:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.347446:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120787.348000:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970524928:0@lo:501: 00000100:00100000:2.0:1789120787.348050:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120787.348772:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8600 going to sleep for 11 seconds 00000100:00100000:1.0:1789120787.358527:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970524928 00000100:00100000:1.0:1789120787.358563:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970524928 00000100:00100000:3.0:1789120787.358935:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789120787.358950:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970524928:12345-0@lo:501: 00000100:00100000:3.0:1789120787.359205:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970524928:12345-0@lo:501: Request processed in 259us (11155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120787.359214:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789120787.361086:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7e940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970524928:0@lo:501: 00000100:00100000:1.0:1789120787.361173:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525056:0@lo:503: 00000100:00100000:1.0:1789120787.361273:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120787.361346:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93300 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.362168:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970525056 00000100:00100000:0.0:1789120787.362177:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970525056 00000100:00100000:0.0:1789120787.362251:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789120787.362263:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970525056:12345-0@lo:503: 00000100:00100000:0.0:1789120787.362445:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970525056:12345-0@lo:503: Request processed in 183us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.362453:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789120787.362780:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525056:0@lo:503: 00000100:00100000:3.0:1789120787.365702:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8906:1876028970525184:0@lo:502: 00000100:00100000:3.0:1789120787.365921:0:8906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.365985:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120787.366272:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970525184 00000100:00100000:2.0:1789120787.366281:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970525184 00000100:00100000:2.0:1789120787.366346:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789120787.366356:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:8906:x1876028970525184:12345-0@lo:502: 00000100:00100000:2.0:1789120787.366539:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:8906:x1876028970525184:12345-0@lo:502: Request processed in 185us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120787.366557:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789120787.369062:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8906:1876028970525184:0@lo:502: 00000100:00100000:3.0:1789120787.369186:0:8906:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8906:1876028970525312:0@lo:502: 00000100:00100000:3.0:1789120787.369275:0:8906:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.369346:0:8906:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461300 going to sleep for 11 seconds 00000100:00100000:1.0:1789120787.371468:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970525312 00000100:00100000:1.0:1789120787.371484:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970525312 00000100:00100000:1.0:1789120787.371577:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789120787.371588:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:8906:x1876028970525312:12345-0@lo:502: 00000100:00100000:1.0:1789120787.371877:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:8906:x1876028970525312:12345-0@lo:502: Request processed in 290us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120787.371887:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789120787.373756:0:8906:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8906:1876028970525312:0@lo:502: 00000040:00080000:3.0:1789120787.373879:0:8906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1789120787.379894:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1789120787.379956:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789120787.379983:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120787.379999:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120787.380013:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789120787.380046:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946883582800 from 5 10000000:01000000:1.0:1789120787.380049:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789120787.380103:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120787.380111:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120787.380122:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120787.380149:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525440:0@lo:101: 00000100:00100000:1.0:1789120787.380232:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.380390:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970525440 00000100:00100000:0.0:1789120787.380399:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970525440 00000100:00100000:0.0:1789120787.380465:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789120787.380478:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970525440:12345-0@lo:101: 00010000:00010000:0.0:1789120787.380494:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120787.380509:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946880031c00/0xb74d2367a830f135 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f12e expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.380542:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946880031c00/0xb74d2367a830f135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f12e expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.380561:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946880031c00/0xb74d2367a830f135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f12e expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.380571:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946880031c00, rc 0) 00000100:00100000:0.0:1789120787.380615:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970525440:12345-0@lo:101: Request processed in 142us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.380622:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789120787.380985:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120787.381011:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525440:0@lo:101: 00010000:00010000:1.0:1789120787.381026:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120787.381036:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120787.381137:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525568:0@lo:256: 00000100:00100000:1.0:1789120787.381168:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120787.382911:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120787.387079:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970525568 00000100:00100000:2.0:1789120787.387106:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970525568 00000100:00100000:2.0:1789120787.387307:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789120787.388497:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970525568:12345-0@lo:256: 20000000:01000000:2.0:1789120787.388541:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789120787.388574:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789120787.388578:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789120787.388773:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970525568:12345-0@lo:256: Request processed in 1454us (7602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120787.388783:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789120787.388956:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525568:0@lo:256: 10000000:01000000:3.0:1789120787.389042:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789120787.389055:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.389068:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120787.389089:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789120787.389093:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:3.0:1789120787.389096:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789120787.389137:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.389146:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.389155:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120787.389177:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525696:0@lo:101: 00000100:00100000:3.0:1789120787.389221:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.389254:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120787.390007:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970525696 00000100:00100000:2.0:1789120787.390015:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970525696 00000100:00100000:2.0:1789120787.390070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789120787.390081:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970525696:12345-0@lo:101: 00010000:00010000:2.0:1789120787.390092:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120787.390108:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a54800/0xb74d2367a830f143 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f13c expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.390144:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a54800/0xb74d2367a830f143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f13c expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.390154:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a54800/0xb74d2367a830f143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f13c expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.390163:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54800, rc 0) 00000100:00100000:2.0:1789120787.390213:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970525696:12345-0@lo:101: Request processed in 133us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120787.390220:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789120787.390262:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525696:0@lo:101: 00010000:00010000:2.0:1789120787.390277:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.390287:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120787.397516:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525824:0@lo:501: 00000100:00100000:2.0:1789120787.397635:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120787.397701:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789120787.397751:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970525824 00000100:00100000:2.0:1789120787.397759:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970525824 00000100:00100000:2.0:1789120787.400564:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789120787.400598:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970525824:12345-0@lo:501: 00000100:00100000:3.0:1789120787.402048:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525824:0@lo:501: 00000100:00100000:3.0:1789120787.402123:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525952:0@lo:503: 00000100:00100000:0.0:1789120787.413065:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.413135:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d4616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.413188:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970525952 00000100:00100000:0.0:1789120787.413200:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970525952 00000100:00100000:0.0:1789120787.413265:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789120787.413277:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970525952:12345-0@lo:503: 00000100:00100000:0.0:1789120787.413473:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970525952:12345-0@lo:503: Request processed in 197us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.413482:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789120787.413564:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970525952:0@lo:503: 00000100:00100000:0.0:1789120787.413903:0:8907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8907:1876028970526080:0@lo:502: 00000100:00100000:0.0:1789120787.413951:0:8907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.413974:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970526080 00000100:00100000:0.0:1789120787.413978:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970526080 00000100:00100000:0.0:1789120787.414000:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789120787.414007:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:8907:x1876028970526080:12345-0@lo:502: 00000100:00100000:0.0:1789120787.414099:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:8907:x1876028970526080:12345-0@lo:502: Request processed in 93us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.414106:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789120787.414139:0:8907:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e226900 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.414153:0:8907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8907:1876028970526080:0@lo:502: 00000020:01000000:0.0:1789120787.414179:0:8907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789120787.414189:0:8907:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789120787.414198:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120787.414201:0:8907:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789120787.414209:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789120787.414214:0:8907:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:0.0:1789120787.414245:0:8907:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789120787.414249:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789120787.414268:0:8907:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9467821e8000) 00000020:00000080:0.0:1789120787.414299:0:8907:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1789120787.414305:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789120787.414416:0:8907:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1789120787.414424:0:8907:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:0.0:1789120787.414433:0:8907:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a830f151 00010000:00080000:0.0:1789120787.414472:0:8907:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468bf682800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789120787.414737:0:8907:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000100:00100000:2.0:1789120787.425260:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970525824:12345-0@lo:501: Request processed in 24653us (27596us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120787.425339:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000040:01000000:0.0:1789120787.433743:0:8907:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789120787.433776:0:8907:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789120787.434094:0:8907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789120787.434508:0:8907:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789120787.434602:0:8907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789120787.434796:0:8907:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789120787.436364:0:8908:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120787.436372:0:8908:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789120787.437193:0:8907:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789120787.437210:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789120787.437550:0:8907:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789120787.437586:0:8907:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a830f158 00000100:00080000:0.0:1789120787.437603:0:8907:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789120787.437610:0:8907:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9468bf682800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789120787.437660:0:8907:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99c5a40 x1876028970526208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789120787.437800:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970526208:0@lo:8: 00000100:00100000:2.0:1789120787.437951:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120787.438171:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970526208 00000100:00100000:1.0:1789120787.438180:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970526208 00000100:00100000:1.0:1789120787.438243:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120787.438254:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970526208:12345-0@lo:8: 00010000:00080000:1.0:1789120787.438293:0:8433:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:1.0:1789120787.438335:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a830f15f 00002000:00100000:1.0:1789120787.438382:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff946782aeb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789120787.438387:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:1.0:1789120787.438391:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1789120787.438475:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789120787.438770:0:8433:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789120787.438802:0:8433:0:(import.c:65:import_set_state_nolock()) ffff946782aeb000 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789120787.439199:0:8907:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789120787.439309:0:8907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120787.439316:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120787.439318:0:8907:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789120787.439322:0:8907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120787.439326:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120787.439327:0:8907:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789120787.439331:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789120787.439333:0:8907:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789120787.439368:0:8907:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8907:1876028970526336:0@lo:502: 00000100:00100000:0.0:1789120787.439425:0:8907:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.439463:0:8907:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0bd6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.439482:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970526336 00000100:00100000:0.0:1789120787.439486:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970526336 00000100:00100000:0.0:1789120787.439523:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789120787.439530:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:8907:x1876028970526336:12345-0@lo:502: 00000100:00100000:0.0:1789120787.439644:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:8907:x1876028970526336:12345-0@lo:502: Request processed in 113us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.439652:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789120787.439930:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970526848:0@lo:400: 00000100:00100000:3.0:1789120787.439969:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.439997:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789120787.440003:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970526464:0@lo:400: 00000100:00100000:3.0:1789120787.440030:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.440048:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970526976:0@lo:400: 00000100:00100000:3.0:1789120787.440067:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.440092:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970526592:0@lo:400: 00000100:00100000:3.0:1789120787.440129:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.440147:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970527104:0@lo:400: 00000100:00100000:3.0:1789120787.440167:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.440186:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120787.440191:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970526720:0@lo:400: 00000100:00100000:3.0:1789120787.440211:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.440250:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970526848 00000100:00100000:3.0:1789120787.440255:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970526848 00000100:00100000:3.0:1789120787.440278:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970526592 00000100:00100000:3.0:1789120787.440281:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970526592 00000100:00100000:3.0:1789120787.440295:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789120787.440301:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970526848:12345-0@lo:400: 00000100:00100000:3.0:1789120787.440344:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970526848:12345-0@lo:400: Request processed in 43us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120787.440352:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789120787.440367:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789120787.440373:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970526592:12345-0@lo:400: 00000100:00100000:3.0:1789120787.440401:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970526592:12345-0@lo:400: Request processed in 29us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120787.440407:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789120787.440425:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970526464 00000100:00100000:3.0:1789120787.440428:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970526464 00000100:00100000:3.0:1789120787.440447:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970526976 00000100:00100000:3.0:1789120787.440449:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970526976 00000100:00100000:3.0:1789120787.440470:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970527104 00000100:00100000:3.0:1789120787.440473:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970527104 00000100:00100000:3.0:1789120787.440484:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970526720 00000100:00100000:3.0:1789120787.440486:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970526720 00000100:00100000:3.0:1789120787.440499:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789120787.440512:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970526464:12345-0@lo:400: 00000100:00100000:3.0:1789120787.440544:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970526464:12345-0@lo:400: Request processed in 33us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120787.440550:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789120787.440563:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789120787.440568:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970526976:12345-0@lo:400: 00000100:00100000:3.0:1789120787.440591:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970526976:12345-0@lo:400: Request processed in 23us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120787.440597:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789120787.440607:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789120787.440612:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970527104:12345-0@lo:400: 00000100:00100000:3.0:1789120787.440635:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970527104:12345-0@lo:400: Request processed in 23us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120787.440641:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789120787.440652:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789120787.440658:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970526720:12345-0@lo:400: 00000100:00100000:3.0:1789120787.440694:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970526720:12345-0@lo:400: Request processed in 24us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120787.440700:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1789120787.440761:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b30c0 x1876028970526464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120787.440778:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970526464:0@lo:400: 00010000:00080000:3.0:1789120787.440790:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b0780 x1876028970526976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120787.440799:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970526976:0@lo:400: 00000100:00100000:3.0:1789120787.440842:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970526848:0@lo:400: 00010000:00080000:3.0:1789120787.440879:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b0f00 x1876028970526720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120787.440888:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970526720:0@lo:400: 00000100:00100000:3.0:1789120787.440898:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970526592:0@lo:400: 00010000:00080000:3.0:1789120787.440907:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b0b40 x1876028970527104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120803 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120787.440915:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970527104:0@lo:400: 00000100:00080000:3.0:1789120787.440935:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120787.440939:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120787.442138:0:8907:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8907:1876028970526336:0@lo:502: 00000020:01000000:0.0:1789120787.442192:0:8907:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120787.442212:0:8907:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120787.442214:0:8907:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789120787.442220:0:8907:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:3.0:1789120787.445569:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:3.0:1789120787.445643:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789120787.445661:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.445677:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120787.445774:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789120787.445778:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946886899000 from 30 10000000:01000000:3.0:1789120787.445781:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789120787.445953:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.445963:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.445998:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120787.446028:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970527232:0@lo:101: 00000100:00100000:3.0:1789120787.446859:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.447044:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.447883:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970527232 00000100:00100000:0.0:1789120787.447896:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970527232 00000100:00100000:0.0:1789120787.447968:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789120787.447980:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970527232:12345-0@lo:101: 00010000:00010000:0.0:1789120787.448001:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120787.448029:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946880031600/0xb74d2367a830f16d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f166 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.448065:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946880031600/0xb74d2367a830f16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f166 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.448079:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946880031600/0xb74d2367a830f16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f166 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.448091:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946880031600, rc 0) 00000100:00100000:0.0:1789120787.448162:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970527232:12345-0@lo:101: Request processed in 184us (1308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.448170:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789120787.449306:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876028970526208:12345-0@lo:8: Request processed in 11043us (11346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120787.449321:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789120787.449576:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970527232:0@lo:101: 00010000:00010000:3.0:1789120787.449618:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.449633:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120787.449779:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970527360:0@lo:501: 00000100:00100000:3.0:1789120787.450143:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.450189:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.450255:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970527360 00000100:00100000:0.0:1789120787.450263:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970527360 00000100:00100000:0.0:1789120787.450311:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789120787.450321:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970527360:12345-0@lo:501: 00000100:00100000:0.0:1789120787.450497:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970527360:12345-0@lo:501: Request processed in 178us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.450504:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789120787.451438:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970527360:0@lo:501: 00000100:00100000:3.0:1789120787.451497:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970527488:0@lo:503: 00000100:00100000:3.0:1789120787.451567:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.451620:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.451777:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970527488 00000100:00100000:0.0:1789120787.451790:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970527488 00000100:00100000:0.0:1789120787.451852:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789120787.451875:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970527488:12345-0@lo:503: 00000100:00100000:0.0:1789120787.451997:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970527488:12345-0@lo:503: Request processed in 137us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.452005:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789120787.452549:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970527488:0@lo:503: 00000100:00100000:1.0:1789120787.455200:0:8910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8910:1876028970527616:0@lo:502: 00000100:00100000:1.0:1789120787.455450:0:8910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120787.455506:0:8910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.455630:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970527616 00000100:00100000:0.0:1789120787.455639:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970527616 00000100:00100000:0.0:1789120787.455710:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789120787.455732:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:8910:x1876028970527616:12345-0@lo:502: 00000100:00100000:0.0:1789120787.456580:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:8910:x1876028970527616:12345-0@lo:502: Request processed in 845us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.456591:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789120787.457096:0:8910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8910:1876028970527616:0@lo:502: 00000100:00100000:1.0:1789120787.457181:0:8910:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8910:1876028970527744:0@lo:502: 00000100:00100000:1.0:1789120787.457441:0:8910:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120787.457481:0:8910:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.457762:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970527744 00000100:00100000:0.0:1789120787.457768:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970527744 00000100:00100000:0.0:1789120787.457849:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789120787.457858:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:8910:x1876028970527744:12345-0@lo:502: 00000100:00100000:0.0:1789120787.458673:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:8910:x1876028970527744:12345-0@lo:502: Request processed in 811us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.458694:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00010000:00080000:2.0:1789120787.461890:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c5a40 x1876028970526208/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789120797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120787.461916:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789120787.461930:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1789120787.461942:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789120787.461951:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789120787.461955:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468bf682800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789120787.461970:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789120787.461979:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970526208:0@lo:8: 00000100:00100000:2.0:1789120787.462085:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876028970527872:0@lo:700: 00000100:00100000:2.0:1789120787.462165:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120787.462216:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120787.462586:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970527872 00000100:00100000:1.0:1789120787.462594:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970527872 00000100:00100000:1.0:1789120787.462670:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789120787.462693:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8909:x1876028970527872:12345-0@lo:700: 00000100:00100000:1.0:1789120787.462754:0:8441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8441:1876028970528000:0@lo:700: 00000100:00100000:1.0:1789120787.462797:0:8441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120787.462835:0:8441:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93900 going to sleep for 11 seconds 00000100:00080000:1.0:1789120787.462875:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120787.462904:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970528000 00000100:00100000:1.0:1789120787.462928:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970528000 00000100:00100000:1.0:1789120787.462960:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789120787.462966:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8441:x1876028970528000:12345-0@lo:700: 00000004:00080000:0.0:1789120787.463572:0:8908:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789120787.463659:0:8908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 237652837379ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789120787.463666:0:8908:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1789120787.468413:0:8910:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d2940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8910:1876028970527744:0@lo:502: 00000040:00080000:3.0:1789120787.468482:0:8910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000004:00080000:1.0:1789120787.471019:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:1.0:1789120787.476269:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000020:01000000:0.0:1789120787.483945:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789120787.484003:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789120787.484020:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.484067:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120787.484080:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789120787.484084:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946886899000 from 5 10000000:01000000:0.0:1789120787.484087:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789120787.484146:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.484155:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.484169:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120787.484199:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970528128:0@lo:101: 00000100:00100000:0.0:1789120787.486395:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.486456:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120787.486962:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970528128 00000100:00100000:3.0:1789120787.486992:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970528128 00000100:00100000:3.0:1789120787.487062:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789120787.487074:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970528128:12345-0@lo:101: 00010000:00010000:3.0:1789120787.487095:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120787.487119:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887082a00/0xb74d2367a830f17b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f174 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.487155:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887082a00/0xb74d2367a830f17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f174 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.487169:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887082a00/0xb74d2367a830f17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f174 expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.487180:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082a00, rc 0) 00000100:00100000:3.0:1789120787.490547:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970528128:12345-0@lo:101: Request processed in 3461us (4148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120787.490562:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789120787.492272:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970528128:0@lo:101: 00010000:00010000:0.0:1789120787.492307:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.492321:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120787.492414:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970528256:0@lo:256: 00000100:00100000:0.0:1789120787.492488:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.492542:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120787.492804:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970528256 00000100:00100000:2.0:1789120787.492812:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970528256 00000100:00100000:2.0:1789120787.492906:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789120787.492915:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970528256:12345-0@lo:256: 20000000:01000000:2.0:1789120787.492940:0:6510:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789120787.492960:0:6510:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789120787.492963:0:6510:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1789120787.493052:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970528256:12345-0@lo:256: Request processed in 137us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120787.493059:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789120787.493249:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970528256:0@lo:256: 10000000:01000000:3.0:1789120787.493317:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789120787.493327:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.493337:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120787.493347:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789120787.493350:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789120787.493352:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789120787.493382:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.493395:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120787.493405:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120787.493419:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970528384:0@lo:101: 00000100:00100000:3.0:1789120787.493448:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.493472:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.495041:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970528384 00000100:00100000:0.0:1789120787.495054:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970528384 00000100:00100000:0.0:1789120787.495128:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789120787.495137:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970528384:12345-0@lo:101: 00010000:00010000:0.0:1789120787.495155:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120787.495176:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946880030800/0xb74d2367a830f189 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f182 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.495209:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946880030800/0xb74d2367a830f189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f182 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.495239:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946880030800/0xb74d2367a830f189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f182 expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.495252:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946880030800, rc 0) 00000100:00100000:1.0:1789120787.495368:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8441:x1876028970528000:12345-0@lo:700: Request processed in 32392us (32560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120787.495384:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789120787.495449:0:8441:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99d3c00 x1876028970528000/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789120803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120787.495462:0:8441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8441:1876028970528000:0@lo:700: 40000000:02000000:1.0:1789120787.495485:0:8441:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000100:00100000:0.0:1789120787.495571:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970528384:12345-0@lo:101: Request processed in 432us (2118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.495579:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789120787.495947:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970528384:0@lo:101: 00010000:00010000:2.0:1789120787.495990:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.496002:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120787.496095:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946889573840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970528512:0@lo:501: 00000100:00100000:2.0:1789120787.496138:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120787.496181:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.496481:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970528512 00000100:00100000:0.0:1789120787.496486:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970528512 00000100:00100000:0.0:1789120787.496522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789120787.496531:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970528512:12345-0@lo:501: 00000100:00100000:0.0:1789120787.496699:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970528512:12345-0@lo:501: Request processed in 169us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.496707:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789120787.496869:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946889573840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970528512:0@lo:501: 00000100:00100000:3.0:1789120787.496915:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970528640:0@lo:503: 00000100:00100000:3.0:1789120787.496963:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120787.496985:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.497186:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970528640 00000100:00100000:0.0:1789120787.497191:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970528640 00000100:00100000:0.0:1789120787.497342:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789120787.497359:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970528640:12345-0@lo:503: 00000100:00100000:0.0:1789120787.497462:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970528640:12345-0@lo:503: Request processed in 104us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.497469:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789120787.497516:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970528640:0@lo:503: 00000100:00100000:3.0:1789120787.500054:0:8911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eae580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8911:1876028970528768:0@lo:502: 00000100:00100000:3.0:1789120787.500168:0:8911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.500579:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970528768 00000100:00100000:0.0:1789120787.500590:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970528768 00000100:00100000:3.0:1789120787.500888:0:8911:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461840 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.501369:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789120787.501385:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:8911:x1876028970528768:12345-0@lo:502: 00000100:00100000:0.0:1789120787.501625:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:8911:x1876028970528768:12345-0@lo:502: Request processed in 244us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.501634:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789120787.501758:0:8911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eae580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8911:1876028970528768:0@lo:502: 00000020:01000000:3.0:1789120787.501800:0:8911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789120787.501810:0:8911:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789120787.501844:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120787.501847:0:8911:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789120787.501854:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789120787.501858:0:8911:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:3.0:1789120787.501890:0:8911:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789120787.501893:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789120787.501914:0:8911:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9468afc7b490) 00000020:00000080:3.0:1789120787.501951:0:8911:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:3.0:1789120787.501960:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789120787.502086:0:8911:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789120787.502093:0:8911:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789120787.502101:0:8911:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a830f197 00010000:00080000:3.0:1789120787.502137:0:8911:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94689e051800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789120787.513075:0:8911:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000001:00100000:1.0:1789120787.522593:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789120787.522988:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8909:x1876028970527872:12345-0@lo:700: Request processed in 60301us (60816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120787.523010:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789120787.523399:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946893a7cb40 x1876028970527872/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789120803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120787.523418:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876028970527872:0@lo:700: 00000004:00080000:0.0:1789120787.539530:0:8909:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789120787.539570:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876028970529024:0@lo:7: 00000100:00100000:0.0:1789120787.539664:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.539740:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0bd6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120787.539901:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970528896:0@lo:13: 00000100:00100000:1.0:1789120787.539939:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120787.539994:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970529024 00000100:00100000:1.0:1789120787.540002:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970529024 00000100:00100000:1.0:1789120787.540049:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789120787.540058:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8909:x1876028970529024:12345-0@lo:7: 00000100:00100000:0.0:1789120787.543084:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970528896 00000100:00100000:0.0:1789120787.543102:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970528896 00000100:00100000:0.0:1789120787.543188:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120787.543201:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876028970528896:12345-0@lo:13: 00002000:00000024:0.0:1789120787.543241:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923828736 avail 3692306432 00000100:00100000:0.0:1789120787.543366:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1876028970528896:12345-0@lo:13: Request processed in 167us (3423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.543385:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789120787.543989:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c6580 x1876028970528896/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120787.544013:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970528896:0@lo:13: 00002000:00080000:1.0:1789120787.548432:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789120787.548445:0:8435:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789120787.549259:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8909:x1876028970529024:12345-0@lo:7: Request processed in 9192us (9586us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120787.549274:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000040:01000000:2.0:1789120787.549340:0:8911:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1789120787.549366:0:8911:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789120787.549662:0:8911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789120787.550411:0:8911:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789120787.550529:0:8911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00010000:00080000:0.0:1789120787.550788:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c5a40 x1876028970529024/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789120803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120787.550808:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876028970529024:0@lo:7: 00000004:00080000:0.0:1789120787.550845:0:8909:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789120787.551086:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876028970529152:0@lo:5: 00000100:00100000:0.0:1789120787.551165:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.551214:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0bd6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120787.551545:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970529152 00000100:00100000:2.0:1789120787.551554:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970529152 00000100:00100000:2.0:1789120787.551628:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789120787.551640:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8909:x1876028970529152:12345-0@lo:5: 00002000:00080000:2.0:1789120787.551676:0:8433:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:2.0:1789120787.551751:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:8909:x1876028970529152:12345-0@lo:5: Request processed in 112us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120787.551759:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789120787.552106:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c5a40 x1876028970529152/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120787.552121:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876028970529152:0@lo:5: 00000004:00080000:0.0:1789120787.552133:0:8909:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789120787.552168:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876028970529280:0@lo:5: 00000100:00100000:0.0:1789120787.552196:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.552233:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0bd6f00 going to sleep for 11 seconds 00000040:00080000:1.0:1789120787.552431:0:8911:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000100:00100000:2.0:1789120787.555158:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970529280 00000100:00100000:2.0:1789120787.555177:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970529280 00000100:00100000:2.0:1789120787.555262:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789120787.555275:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8909:x1876028970529280:12345-0@lo:5: 00002000:00080000:2.0:1789120787.555338:0:8435:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000040:00080000:1.0:1789120787.558136:0:8912:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120787.558145:0:8912:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000100:00100000:2.0:1789120787.559610:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:8909:x1876028970529280:12345-0@lo:5: Request processed in 4329us (7403us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789120787.559624:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789120787.559912:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c5a40 x1876028970529280/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120787.559937:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8909:1876028970529280:0@lo:5: 00000004:00080000:1.0:1789120787.559960:0:8909:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:1.0:1789120787.560020:0:8909:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8909:1876028970529408:0@lo:900: 00000100:00100000:1.0:1789120787.560070:0:8909:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120787.560098:0:8909:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93480 going to sleep for 11 seconds 00000100:00100000:0.0:1789120787.560217:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970529408 00000100:00100000:0.0:1789120787.560238:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970529408 00000100:00100000:0.0:1789120787.560295:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789120787.560305:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8909:x1876028970529408:12345-0@lo:900: 00000100:00100000:0.0:1789120787.560373:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:8909:x1876028970529408:12345-0@lo:900: Request processed in 71us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.560396:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789120787.560480:0:8909:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99d0f00 x1876028970529408/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789120803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120787.560492:0:8909:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8909:1876028970529408:0@lo:900: 00000020:00000080:2.0:1789120787.561465:0:8911:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789120787.561486:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789120787.561543:0:8911:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789120787.561575:0:8911:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a830f19e 00000100:00080000:2.0:1789120787.561588:0:8911:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789120787.561594:0:8911:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94689e051800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789120787.561627:0:8911:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946889573840 x1876028970529536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789120787.561723:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946889573840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970529536:0@lo:8: 00000100:00100000:3.0:1789120787.561791:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.562037:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970529536 00000100:00100000:0.0:1789120787.562043:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970529536 00000100:00100000:0.0:1789120787.562078:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120787.562086:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970529536:12345-0@lo:8: 00010000:00080000:0.0:1789120787.562115:0:8434:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 237 last 0 00000020:00000080:0.0:1789120787.562147:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a830f1a5 00002000:00100000:0.0:1789120787.562164:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9468bf680000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789120787.562169:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1789120787.562172:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:2.0:1789120787.562431:0:8911:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789120787.562533:0:8911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120787.562539:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120787.562541:0:8911:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789120787.562545:0:8911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120787.562550:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120787.562551:0:8911:0:(obd_config.c:1563:class_process_config()) marker 28 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789120787.562555:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789120787.562557:0:8911:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789120787.562610:0:8911:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c39e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8911:1876028970529664:0@lo:502: 00000100:00100000:2.0:1789120787.562665:0:8911:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:0.0:1789120787.562809:0:8434:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789120787.562882:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9468bf682000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789120787.562961:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970529664 00000100:00100000:2.0:1789120787.562966:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970529664 00000100:00100000:2.0:1789120787.563003:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789120787.563010:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+20:8911:x1876028970529664:12345-0@lo:502: 00010000:00080000:3.0:1789120787.565376:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946889573840 x1876028970529536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789120797 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120787.565395:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789120787.565407:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789120787.565419:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789120787.565427:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789120787.565431:0:3643:0:(import.c:65:import_set_state_nolock()) ffff94689e051800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789120787.565484:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789120787.565492:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946889573840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970529536:0@lo:8: 00000100:00100000:0.0:1789120787.565556:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876028970529536:12345-0@lo:8: Request processed in 3132us (3427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.565570:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789120787.565838:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+20:8911:x1876028970529664:12345-0@lo:502: Request processed in 2825us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120787.565851:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789120787.565959:0:8911:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120787.565974:0:8911:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c39e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:8911:1876028970529664:0@lo:502: 00000020:01000000:2.0:1789120787.566008:0:8911:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120787.566017:0:8911:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120787.566019:0:8911:0:(obd_config.c:1563:class_process_config()) marker 28 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789120787.566024:0:8911:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789120787.566387:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789120787.566418:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789120787.566431:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.566443:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120787.566455:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789120787.566458:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9468ab900000 from 1 10000000:01000000:0.0:1789120787.566461:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789120787.566503:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.566520:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120787.566531:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120787.566554:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970529792:0@lo:101: 00000100:00100000:0.0:1789120787.566606:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.566646:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afddaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120787.566776:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970529792 00000100:00100000:2.0:1789120787.566784:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970529792 00000100:00100000:2.0:1789120787.566921:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789120787.566934:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970529792:12345-0@lo:101: 00010000:00010000:2.0:1789120787.566951:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120787.566968:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a54200/0xb74d2367a830f1b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f1ac expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.566998:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a54200/0xb74d2367a830f1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f1ac expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.567008:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a54200/0xb74d2367a830f1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f1ac expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.567018:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54200, rc 0) 00000100:00100000:2.0:1789120787.567061:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970529792:12345-0@lo:101: Request processed in 130us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120787.567069:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789120787.567108:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970529792:0@lo:101: 00010000:00010000:2.0:1789120787.567121:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.567130:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120787.567200:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c39e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970529920:0@lo:501: 00000100:00100000:2.0:1789120787.568347:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120787.568391:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120787.568416:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970529920 00000100:00100000:2.0:1789120787.568421:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970529920 00000100:00100000:2.0:1789120787.568463:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789120787.568471:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970529920:12345-0@lo:501: 00000100:00100000:2.0:1789120787.568578:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970529920:12345-0@lo:501: Request processed in 107us (235us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789120787.568587:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789120787.568632:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c39e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970529920:0@lo:501: 10000000:01000000:2.0:1789120787.568677:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789120787.568685:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120787.568696:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789120787.569934:0:8913:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789120787.569969:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876028970530176:0@lo:7: 00000100:00100000:0.0:1789120787.570035:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.570064:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdda600 going to sleep for 11 seconds 00000100:00100000:3.0:1789120787.570169:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970530048:0@lo:13: 00000100:00100000:3.0:1789120787.570205:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120787.570466:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970530176 00000100:00100000:2.0:1789120787.570473:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970530176 00000100:00100000:2.0:1789120787.570585:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789120787.570596:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8913:x1876028970530176:12345-0@lo:7: 00000100:00100000:0.0:1789120787.572514:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970530048 00000100:00100000:0.0:1789120787.572526:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970530048 00000100:00100000:0.0:1789120787.572592:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789120787.572602:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876028970530048:12345-0@lo:13: 00002000:00000024:0.0:1789120787.572629:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:0.0:1789120787.572743:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eada40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876028970530048:12345-0@lo:13: Request processed in 142us (2536us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120787.572752:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789120787.572818:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c7c00 x1876028970530048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120787.572887:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970530048:0@lo:13: 00000004:00080000:1.0:1789120787.573071:0:8912:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789120787.573189:0:8912:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 237762367315ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789120787.573196:0:8912:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789120787.574607:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:3.0:1789120787.576019:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1789120787.578068:0:8433:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789120787.578077:0:8433:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789120787.578301:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8913:x1876028970530176:12345-0@lo:7: Request processed in 7700us (8258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120787.578326:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789120787.578438:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c4f00 x1876028970530176/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789120803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120787.578465:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876028970530176:0@lo:7: 00000004:00080000:0.0:1789120787.578484:0:8913:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1789120787.578537:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876028970530304:0@lo:5: 00000100:00100000:0.0:1789120787.578581:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.579256:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdda600 going to sleep for 11 seconds 00000100:00100000:3.0:1789120787.579324:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970530304 00000100:00100000:3.0:1789120787.579332:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970530304 00000100:00100000:3.0:1789120787.579423:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789120787.579435:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8913:x1876028970530304:12345-0@lo:5: 00002000:00080000:3.0:1789120787.579481:0:8434:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789120787.579486:0:8434:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:1.0:1789120787.585583:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00100000:1.0:1789120787.585610:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1789120787.585617:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1789120787.586165:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8913:x1876028970530304:12345-0@lo:5: Request processed in 6725us (7576us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789120787.586178:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789120787.586344:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c4f00 x1876028970530304/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120803 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120787.586359:0:8913:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789120787.586366:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876028970530304:0@lo:5: 00000004:00080000:0.0:1789120787.586385:0:8913:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789120787.586446:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876028970530432:0@lo:700: 00000100:00100000:0.0:1789120787.586513:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120787.586582:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdda600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120787.586626:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970530432 00000100:00100000:2.0:1789120787.586633:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970530432 00000100:00100000:2.0:1789120787.586733:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120787.586743:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8913:x1876028970530432:12345-0@lo:700: 00000100:00100000:2.0:1789120787.600297:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8913:x1876028970530432:12345-0@lo:700: Request processed in 13537us (13764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120787.600317:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789120787.600442:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c4f00 x1876028970530432/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789120803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120787.600460:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876028970530432:0@lo:700: 00000004:02000040:0.0:1789120787.601789:0:8913:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1789120787.612178:0:8913:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876028970530560:0@lo:5: 00000100:00100000:1.0:1789120787.612286:0:8913:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120787.612343:0:8913:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120787.612449:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970530560 00000100:00100000:2.0:1789120787.612459:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970530560 00000100:00100000:2.0:1789120787.612535:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789120787.612547:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8913:x1876028970530560:12345-0@lo:5: 00002000:00080000:3.0:1789120787.620640:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789120787.620668:0:8435:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1789120787.622692:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8913:x1876028970530560:12345-0@lo:5: Request processed in 10134us (10393us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789120787.622709:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789120787.623375:0:8913:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99d03c0 x1876028970530560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120803 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120787.623399:0:8913:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d03c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8913:1876028970530560:0@lo:5: 00000004:00080000:0.0:1789120787.623421:0:8913:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:3.0:1789120788.114433:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789120788.283784:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:3.0:1789120789.137950:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789120789.335664:0:8965:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789120789.336291:0:8965:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789120790.164483:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789120790.354185:0:9013:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789120790.354198:0:9013:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789120790.931800:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120790.931934:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970530688:0@lo:41: 00000100:00100000:0.0:1789120790.932035:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120790.932119:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120790.932130:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970530816:0@lo:41: 00000100:00100000:0.0:1789120790.932159:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120790.932196:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970530688 00000100:00100000:0.0:1789120790.932206:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970530688 00000100:00100000:1.0:1789120790.935498:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970530816 00000100:00100000:1.0:1789120790.935519:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970530816 00000100:00100000:1.0:1789120790.935618:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789120790.935630:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970530816:12345-0@lo:41: 00000004:00000024:1.0:1789120790.935693:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789120790.935809:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970530816:12345-0@lo:41: Request processed in 181us (3648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120790.935818:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789120790.935994:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970530816:0@lo:41: 00000100:00100000:0.0:1789120790.936030:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789120790.936039:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970530688:12345-0@lo:41: 00000004:00000024:0.0:1789120790.936060:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:0.0:1789120790.936106:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970530688:12345-0@lo:41: Request processed in 70us (4072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120790.936112:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789120790.936143:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970530688:0@lo:41: 00010000:00010000:1.0:1789120791.187022:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120792.210980:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120792.979270:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970530944:0@lo:400: 00000100:00100000:1.0:1789120792.979352:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120792.979424:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970531456:0@lo:400: 00000100:00100000:2.0:1789120792.979427:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970530944 00000100:00100000:2.0:1789120792.979442:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970530944 00000100:00100000:1.0:1789120792.979463:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120792.979526:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789120792.979540:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:3645:x1876028970530944:12345-0@lo:400: 00000100:00100000:1.0:1789120792.979584:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970531968:0@lo:400: 00000100:00100000:1.0:1789120792.979655:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120792.979656:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:3645:x1876028970530944:12345-0@lo:400: Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120792.979682:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789120792.979737:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970530944:0@lo:400: 00000100:00100000:1.0:1789120792.979765:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789120792.979775:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970531328:0@lo:13: 00000100:00100000:0.0:1789120792.984545:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970531456 00000100:00100000:0.0:1789120792.984771:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970531456 00000100:00100000:0.0:1789120792.985108:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789120792.985123:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970531456:12345-0@lo:400: 00000100:00100000:0.0:1789120792.985231:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970531456:12345-0@lo:400: Request processed in 112us (5768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120792.985239:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789120792.985442:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120792.985487:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970531840:0@lo:400: 00000100:00100000:1.0:1789120792.985715:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120792.985765:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970531456:0@lo:400: 00000100:00100000:2.0:1789120792.985796:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970531968 00000100:00100000:2.0:1789120792.985810:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970531968 00000100:00100000:2.0:1789120792.985911:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970531840 00000100:00100000:2.0:1789120792.985915:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970531840 00000100:00100000:2.0:1789120792.985938:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789120792.985947:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970531968:12345-0@lo:400: 00000100:00100000:2.0:1789120792.986058:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970531968:12345-0@lo:400: Request processed in 112us (6415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120792.986066:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789120792.986084:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789120792.986090:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970531840:12345-0@lo:400: 00000100:00100000:2.0:1789120792.986124:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970531840:12345-0@lo:400: Request processed in 34us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120792.986133:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789120792.986152:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970531072:0@lo:400: 00000100:00080000:2.0:1789120792.986157:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120792.986165:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789120792.986201:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120792.986229:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970531584:0@lo:400: 00000100:00100000:1.0:1789120792.986249:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120792.986263:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970532096:0@lo:400: 00000100:00100000:1.0:1789120792.986287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120792.986295:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970531072 00000100:00100000:2.0:1789120792.986302:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970531072 00000100:00100000:1.0:1789120792.986325:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789120792.986331:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970531584 00000100:00100000:2.0:1789120792.986337:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970531584 00000100:00100000:1.0:1789120792.986338:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970531200:0@lo:13: 00000100:00100000:2.0:1789120792.986361:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789120792.986370:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970531072:12345-0@lo:400: 00000100:00100000:1.0:1789120792.986378:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120792.986416:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970531712:0@lo:400: 00000100:00100000:2.0:1789120792.986433:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970531072:12345-0@lo:400: Request processed in 60us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120792.986441:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789120792.986463:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789120792.986465:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120792.986474:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970531584:12345-0@lo:400: 00000100:00100000:1.0:1789120792.986520:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970532224:0@lo:400: 00000100:00100000:0.0:1789120792.986769:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970531328 00000100:00100000:0.0:1789120792.986777:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970531328 00000100:00100000:0.0:1789120792.987154:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970531200 00000100:00100000:0.0:1789120792.987159:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970531200 00000100:00100000:0.0:1789120792.987179:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120792.987196:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970531328:12345-0@lo:13: 00002000:00000024:0.0:1789120792.987228:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120792.989975:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970531584:12345-0@lo:400: Request processed in 3482us (3703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120792.989993:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789120792.990065:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970531712 00000100:00100000:2.0:1789120792.990075:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970531712 00000100:00100000:2.0:1789120792.990145:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789120792.990158:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970531328:12345-0@lo:13: Request processed in 2943us (4698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120792.990169:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970531712:12345-0@lo:400: 00000100:00100000:0.0:1789120792.990179:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120792.990225:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789120792.990239:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970531200:12345-0@lo:13: 00002000:00000024:0.0:1789120792.990267:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120792.990274:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970531712:12345-0@lo:400: Request processed in 113us (3816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120792.990284:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789120792.990321:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970531200:12345-0@lo:13: Request processed in 85us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120792.990328:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789120792.990359:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120792.990752:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120792.990870:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970532096 00000100:00100000:2.0:1789120792.990877:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970532096 00000100:00100000:2.0:1789120792.990923:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970532224 00000100:00100000:2.0:1789120792.990926:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970532224 00000100:00100000:2.0:1789120792.990950:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789120792.990957:0:8435:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789120792.990962:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970532096:12345-0@lo:400: 00000100:00100000:0.0:1789120792.990982:0:8435:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789120792.991019:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970532096:12345-0@lo:400: Request processed in 61us (4732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120792.991026:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789120792.991044:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789120792.991051:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970532224:12345-0@lo:400: 00000100:00100000:2.0:1789120792.991082:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970532224:12345-0@lo:400: Request processed in 33us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120792.991088:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789120792.991755:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468938e83c0 x1876028970531072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120792.991775:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970531072:0@lo:400: 00010000:00080000:1.0:1789120792.991798:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf64c000 x1876028970531584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120792.992191:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970531584:0@lo:400: 00010000:00080000:1.0:1789120792.992213:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf64ed00 x1876028970532096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120792.992222:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789120792.992239:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970532096:0@lo:400: 00010000:00080000:1.0:1789120792.992267:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946782b383c0 x1876028970531200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120792.992275:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1789120792.992292:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970531200:0@lo:13: 00000100:00100000:1.0:1789120792.992305:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970531712:0@lo:400: 00010000:00080000:1.0:1789120792.992316:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf64e1c0 x1876028970532224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120792.992324:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970532224:0@lo:400: 00010000:00080000:1.0:1789120792.992362:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b9c3a580 x1876028970531328/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120792.992374:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970531328:0@lo:13: 00010000:00080000:1.0:1789120792.992402:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf64cf00 x1876028970531840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120792.992411:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970531840:0@lo:400: 00010000:00080000:1.0:1789120792.992424:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf64d2c0 x1876028970531968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120808 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120792.992434:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970531968:0@lo:400: 00010000:00010000:3.0:1789120793.234962:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120794.259518:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120795.287484:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120796.052123:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970532352:0@lo:41: 00000100:00100000:1.0:1789120796.052234:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120796.052313:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120796.052320:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970532480:0@lo:41: 00000100:00100000:1.0:1789120796.052345:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120796.052381:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970532352 00000100:00100000:1.0:1789120796.052389:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970532352 00000100:00100000:1.0:1789120796.052431:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970532480 00000100:00100000:1.0:1789120796.052433:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970532480 00000100:00100000:1.0:1789120796.052449:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789120796.052459:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970532352:12345-0@lo:41: 00000004:00000024:1.0:1789120796.052509:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789120796.052563:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970532352:12345-0@lo:41: Request processed in 105us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120796.052571:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789120796.052590:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789120796.052596:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970532480:12345-0@lo:41: 00000004:00000024:1.0:1789120796.052614:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789120796.052652:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970532480:12345-0@lo:41: Request processed in 56us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120796.052675:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789120796.052726:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970532480:0@lo:41: 00000100:00100000:1.0:1789120796.052739:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970532352:0@lo:41: 00010000:00010000:0.0:1789120796.307779:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120797.329970:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120798.098403:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120798.098435:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970532608:0@lo:13: 00000100:00100000:0.0:1789120798.098512:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120798.098697:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120798.098710:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970532736:0@lo:400: 00000100:00100000:1.0:1789120798.098747:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120798.098800:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970533120:0@lo:400: 00000100:00100000:1.0:1789120798.098846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120798.098865:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970533632:0@lo:400: 00000100:00100000:1.0:1789120798.099098:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120798.099125:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120798.099131:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970533248:0@lo:400: 00000100:00100000:1.0:1789120798.099155:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120798.099180:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970532864:0@lo:400: 00000100:00100000:1.0:1789120798.099203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120798.099219:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970533376:0@lo:400: 00000100:00100000:1.0:1789120798.099236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120798.099251:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789120798.099255:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946889573840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970532992:0@lo:400: 00000100:00100000:1.0:1789120798.099272:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120798.099284:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970533504:0@lo:400: 00000100:00100000:1.0:1789120798.099318:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120798.099348:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970533248 00000100:00100000:1.0:1789120798.099355:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970533248 00000100:00100000:1.0:1789120798.099403:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970532992 00000100:00100000:1.0:1789120798.099407:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970532992 00000100:00100000:1.0:1789120798.099422:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789120798.099430:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970533248:12345-0@lo:400: 00000100:00100000:1.0:1789120798.099486:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970533248:12345-0@lo:400: Request processed in 57us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120798.099495:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789120798.099512:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789120798.099518:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970532992:12345-0@lo:400: 00000100:00100000:1.0:1789120798.099685:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970532992:12345-0@lo:400: Request processed in 167us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120798.099692:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789120798.099713:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970533120 00000100:00100000:1.0:1789120798.099717:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970533120 00000100:00100000:1.0:1789120798.099736:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970532864 00000100:00100000:1.0:1789120798.099740:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970532864 00000100:00100000:1.0:1789120798.099751:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970533376 00000100:00100000:1.0:1789120798.099753:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970533376 00000100:00100000:1.0:1789120798.099791:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970533504 00000100:00100000:1.0:1789120798.099794:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970533504 00000100:00100000:1.0:1789120798.099810:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789120798.099816:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970533120:12345-0@lo:400: 00000100:00100000:0.0:1789120798.100009:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970532608 00000100:00100000:0.0:1789120798.100014:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970532608 00000100:00100000:0.0:1789120798.100046:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120798.100053:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970532608:12345-0@lo:13: 00002000:00000024:0.0:1789120798.100077:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120798.100118:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970532608:12345-0@lo:13: Request processed in 65us (1606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120798.100124:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789120798.100143:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970532736 00000100:00100000:0.0:1789120798.100147:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970532736 00000100:00100000:0.0:1789120798.100179:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789120798.100184:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:3646:x1876028970532736:12345-0@lo:400: 00000100:00100000:0.0:1789120798.100211:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:3646:x1876028970532736:12345-0@lo:400: Request processed in 28us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120798.100217:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00080000:0.0:1789120798.100261:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946782b38000 x1876028970532608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120798.100278:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970532608:0@lo:13: 00000100:00100000:3.0:1789120798.100437:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970533632 00000100:00100000:3.0:1789120798.100442:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970533632 00000100:00100000:3.0:1789120798.100474:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120798.100481:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970533632:12345-0@lo:400: 00000100:00100000:3.0:1789120798.100516:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970533632:12345-0@lo:400: Request processed in 35us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120798.100521:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120798.100888:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789120798.100898:0:6519:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789120798.100915:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789120798.100925:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789120798.100933:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970532864:12345-0@lo:400: 00000100:00100000:3.0:1789120798.100979:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970532864:12345-0@lo:400: Request processed in 48us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120798.100986:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789120798.101479:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970533120:12345-0@lo:400: Request processed in 1659us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120798.101487:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789120798.101507:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789120798.101516:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970533376:12345-0@lo:400: 00000100:00100000:1.0:1789120798.102102:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970533376:12345-0@lo:400: Request processed in 586us (2861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120798.102120:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789120798.102135:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789120798.102142:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970533504:12345-0@lo:400: 00000100:00100000:1.0:1789120798.102177:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970533504:12345-0@lo:400: Request processed in 36us (2859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120798.102182:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789120798.102207:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120798.102212:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120798.102215:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120798.102325:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970533248:0@lo:400: 00010000:00080000:1.0:1789120798.102342:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b0b40 x1876028970533120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120798.102353:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970533120:0@lo:400: 00010000:00080000:1.0:1789120798.102365:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b0780 x1876028970533632/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120798.102375:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970533632:0@lo:400: 00000100:00100000:1.0:1789120798.102386:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970532736:0@lo:400: 00000100:00100000:3.0:1789120798.102407:0:6520:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789120798.102426:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946889573840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970532992:0@lo:400: 00010000:00080000:1.0:1789120798.102437:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b21c0 x1876028970533504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120798.102446:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970533504:0@lo:400: 00010000:00080000:1.0:1789120798.102457:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468a2ead2c0 x1876028970532864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120798.102476:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2ead2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970532864:0@lo:400: 00010000:00080000:1.0:1789120798.102489:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99b0f00 x1876028970533376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120798.102496:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970533376:0@lo:400: 00000100:00100000:3.0:1789120798.104152:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120798.109028:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970533760:0@lo:13: 00000100:00100000:3.0:1789120798.109125:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120798.114271:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970533760 00000100:00100000:1.0:1789120798.114285:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970533760 00000100:00100000:1.0:1789120798.114345:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789120798.114355:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970533760:12345-0@lo:13: 00002000:00000024:1.0:1789120798.114385:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120798.114476:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970533760:12345-0@lo:13: Request processed in 123us (5351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120798.114482:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789120798.114685:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b9c383c0 x1876028970533760/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120798.114707:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970533760:0@lo:13: 00010000:00010000:2.0:1789120798.354149:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120799.378036:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120800.415460:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120801.171237:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970533888:0@lo:41: 00000100:00100000:1.0:1789120801.171331:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120801.171399:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120801.171406:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970534016:0@lo:41: 00000100:00100000:1.0:1789120801.171430:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120801.171967:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970533888 00000100:00100000:1.0:1789120801.171980:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970533888 00000100:00100000:1.0:1789120801.174153:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970534016 00000100:00100000:1.0:1789120801.174168:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970534016 00000100:00100000:1.0:1789120801.174195:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789120801.174206:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946889573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970533888:12345-0@lo:41: 00000004:00000024:1.0:1789120801.174256:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1789120801.174374:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946889573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970533888:12345-0@lo:41: Request processed in 170us (3043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120801.174382:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789120801.174402:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789120801.174408:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970534016:12345-0@lo:41: 00000004:00000024:1.0:1789120801.174426:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1789120801.174450:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970534016:12345-0@lo:41: Request processed in 43us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120801.174456:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789120801.174627:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970534016:0@lo:41: 00000100:00100000:2.0:1789120801.174647:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970533888:0@lo:41: 00010000:00010000:0.0:1789120801.427173:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789120802.098636:0:9514:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789120802.098642:0:9514:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1789120802.098643:0:9514:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789120802.098802:0:9514:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff946782aee800 00000020:01000004:1.0:1789120802.098851:0:9514:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789120802.098866:0:9514:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789120802.098880:0:9514:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff94678285ced8) 00000020:00000080:1.0:1789120802.098896:0:9514:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789120802.172356:0:9514:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789120802.172450:0:9514:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:0.0:1789120802.220654:0:9514:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789120802.222360:0:9514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1789120802.222379:0:9514:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789120802.222395:0:9514:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb74d2367a830f1c1 00000020:01000004:0.0:1789120802.222404:0:9514:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789120802.222437:0:9514:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1789120802.222442:0:9514:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1789120802.222449:0:9514:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1789120802.222484:0:9514:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1789120802.222489:0:9514:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789120802.305200:0:9514:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789120802.305250:0:9514:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.132@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789120802.305256:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789120802.305258:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789120802.305259:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789120802.305267:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789120802.305268:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789120802.305269:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789120802.305271:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789120802.305272:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789120802.305273:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789120802.305275:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789120802.305276:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789120802.305280:0:9514:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789120802.305282:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789120802.305283:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789120802.305284:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789120802.305285:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789120802.305286:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789120802.305287:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789120802.305287:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789120802.305288:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789120802.305289:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789120802.305290:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789120802.305290:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789120802.305326:0:9514:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789120802.305353:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970534144:0@lo:253: 00000100:00100000:2.0:1789120802.305451:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120802.305518:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bba300 going to sleep for 11 seconds 00000100:00100000:3.0:1789120802.305922:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970534144 00000100:00100000:3.0:1789120802.305933:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970534144 00000100:00100000:3.0:1789120802.306015:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1789120802.306026:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:9514:x1876028970534144:12345-0@lo:253: 20000000:01000000:3.0:1789120802.306066:0:6510:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789120802.306072:0:6510:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1789120802.306079:0:6510:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1789120802.306084:0:6510:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1789120802.306381:0:6510:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789120802.306527:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:3.0:1789120802.306665:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1789120802.306686:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:3.0:1789120802.306695:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1789120802.306708:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:3.0:1789120802.306722:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:3.0:1789120802.306865:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:3.0:1789120802.306884:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.132@tcp 20000000:01000000:3.0:1789120802.306887:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:3.0:1789120802.306902:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:3.0:1789120802.306920:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789120802.306936:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:3.0:1789120802.306941:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:3.0:1789120802.306952:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:3.0:1789120802.306958:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789120802.306969:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:3.0:1789120802.307194:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:3.0:1789120802.307277:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:3.0:1789120802.307289:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.132@tcp 20000000:01000000:3.0:1789120802.307291:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:3.0:1789120802.307305:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:3.0:1789120802.307310:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789120802.307322:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:3.0:1789120802.307326:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:3.0:1789120802.307337:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:3.0:1789120802.307341:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789120802.307351:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:3.0:1789120802.307365:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:3.0:1789120802.307772:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:3.0:1789120802.307786:0:6510:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.132@tcp 20000000:01000000:3.0:1789120802.307788:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.132@tcp (null) (null) (null) 00000040:00080000:3.0:1789120802.307803:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:3.0:1789120802.307809:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789120802.307863:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:3.0:1789120802.307872:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.132@tcp (null) (null) 00000040:00080000:3.0:1789120802.307885:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:3.0:1789120802.307890:0:6510:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1789120802.307900:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:3.0:1789120802.307914:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:3.0:1789120802.307927:0:6510:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789120802.307937:0:6510:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789120802.307941:0:6510:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789120802.308775:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789120802.308779:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789120802.309504:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 25 1->4: lustre sys.timeout 20000000:01000000:3.0:1789120802.309564:0:9520:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 25 2->4: lustre sys.timeout 00000040:00080000:3.0:1789120802.309593:0:9520:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:3.0:1789120802.316215:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:3.0:1789120802.316265:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:3.0:1789120802.316281:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 20000000:01000000:3.0:1789120802.316300:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789120802.316303:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789120802.321787:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1789120802.321913:0:9521:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1789120802.321927:0:9521:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1789120802.322427:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1789120802.322457:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:0.0:1789120802.322474:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:0.0:1789120802.322487:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789120802.322490:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789120802.323294:0:9522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:0.0:1789120802.323442:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:0.0:1789120802.323465:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:0.0:1789120802.323483:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:0.0:1789120802.323493:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1789120802.323509:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789120802.325067:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1789120802.325111:0:9523:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1789120802.325127:0:9523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1789120802.328797:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1789120802.330928:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1789120802.330962:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1789120802.331051:0:6510:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789120802.331055:0:6510:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789120802.335197:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 28 1->4: lustre sys.timeout 20000000:01000000:3.0:1789120802.335261:0:9524:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 28 2->4: lustre sys.timeout 00000040:00080000:3.0:1789120802.335277:0:9524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1789120802.345920:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1789120802.346045:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1789120802.346068:0:6510:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 10000000:01000000:1.0:1789120802.346096:0:6510:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789120802.346126:0:6510:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.346150:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946887083200/0xb74d2367a830f0be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f0b7 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.346184:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946880030a00/0xb74d2367a830f0e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f0e1 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.346192:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946880030400/0xb74d2367a830f127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f120 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.346200:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a54800/0xb74d2367a830f143 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f13c expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.346208:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946880031600/0xb74d2367a830f16d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f166 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.346215:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946880030800/0xb74d2367a830f189 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f182 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.346223:0:6510:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a54200/0xb74d2367a830f1b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f1ac expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.346231:0:6510:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.346280:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a54200/0xb74d2367a830f1b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f1ac expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.346300:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946899a54200/0xb74d2367a830f1b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f1ac expref: 21 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120802.346318:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970534272:0@lo:104: 00000100:00100000:1.0:1789120802.346421:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120802.346620:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946880030800/0xb74d2367a830f189 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f182 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.346630:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946880030800/0xb74d2367a830f189 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f182 expref: 21 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120802.346638:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f8b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970534400:0@lo:104: 00000100:00100000:1.0:1789120802.346685:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.353322:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970534272 00000100:00100000:0.0:1789120802.353343:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970534272 00000100:00100000:0.0:1789120802.353413:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970534400 00000100:00100000:0.0:1789120802.353416:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970534400 00000100:00100000:0.0:1789120802.353459:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120802.353470:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:6510:x1876028970534272:12345-0@lo:104: 00010000:00010000:0.0:1789120802.353493:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.353639:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120802.353646:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f83c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:6510:x1876028970534272:12345-0@lo:104: Request processed in 178us (7226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.353664:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120802.353685:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789120802.353692:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:6510:x1876028970534400:12345-0@lo:104: 00010000:00010000:0.0:1789120802.353701:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.353749:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789120802.353754:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:6510:x1876028970534400:12345-0@lo:104: Request processed in 63us (7069us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.353761:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1789120802.353788:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789120802.353796:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.353804:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946880030e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789120802.353809:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.353848:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120802.353855:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120802.353862:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120802.353907:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.353914:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120802.353937:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.353944:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946880030e00/0xb74d2367a830f1ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f1b3 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.353961:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120802.353964:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.353969:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887082200 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789120802.353972:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.353993:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120802.353999:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120802.354010:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120802.354025:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354031:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120802.354036:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354042:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f189 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354051:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120802.354053:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120802.354054:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120802.354062:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120802.354080:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970534656:0@lo:103: 00000100:00100000:0.0:1789120802.354127:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.354174:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120802.354181:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970534528:0@lo:103: 00000100:00100000:0.0:1789120802.354203:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.354231:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970534656 00000100:00100000:0.0:1789120802.354236:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970534656 00010000:00010000:0.0:1789120802.354257:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946880030800/0xb74d2367a830f189 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f182 expref: 22 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.354281:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970534528 00000100:00100000:0.0:1789120802.354284:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970534528 00010000:00010000:0.0:1789120802.354295:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a54200/0xb74d2367a830f1b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f1ac expref: 23 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.354321:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120802.354327:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+23:3647:x1876028970534656:12345-0@lo:103: 00010000:00010000:0.0:1789120802.354339:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120802.354345:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946880030800/0xb74d2367a830f189 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f182 expref: 23 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354355:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946880030800/0xb74d2367a830f189 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f182 expref: 23 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354378:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120802.354407:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+23:3647:x1876028970534656:12345-0@lo:103: Request processed in 81us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.354414:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120802.354427:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789120802.354434:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+22:3647:x1876028970534528:12345-0@lo:103: 00010000:00010000:0.0:1789120802.354441:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120802.354445:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a54200/0xb74d2367a830f1b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f1ac expref: 22 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354455:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a54200/0xb74d2367a830f1b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f1ac expref: 22 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354464:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120802.354484:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+22:3647:x1876028970534528:12345-0@lo:103: Request processed in 51us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.354491:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789120802.354533:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970534528:0@lo:103: 00000100:00100000:0.0:1789120802.354552:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970534656:0@lo:103: 00010000:00010000:0.0:1789120802.354600:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946880031600/0xb74d2367a830f16d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f166 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354614:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946880031600/0xb74d2367a830f16d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f166 expref: 21 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.354624:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b392c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970534784:0@lo:104: 00000100:00100000:0.0:1789120802.354650:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120802.354675:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a54800/0xb74d2367a830f143 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f13c expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354683:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946899a54800/0xb74d2367a830f143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f13c expref: 21 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.354692:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970534912:0@lo:104: 00000100:00100000:0.0:1789120802.354711:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120802.354728:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946880030400/0xb74d2367a830f127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f120 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354736:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946880030400/0xb74d2367a830f127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f120 expref: 21 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.354744:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b39680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970535040:0@lo:104: 00000100:00100000:0.0:1789120802.354764:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120802.354781:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946880030a00/0xb74d2367a830f0e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f0e1 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354788:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946880030a00/0xb74d2367a830f0e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f0e1 expref: 21 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.354803:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3bc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970535168:0@lo:104: 00000100:00100000:0.0:1789120802.354851:0:6510:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120802.354871:0:6510:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946887083200/0xb74d2367a830f0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f0b7 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.354879:0:6510:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946887083200/0xb74d2367a830f0be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f0b7 expref: 21 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.354888:0:6510:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970535296:0@lo:104: 00000100:00100000:0.0:1789120802.354905:0:6510:0:(client.c:2715:ptlrpc_set_wait()) set ffff946888669600 going to sleep for 11 seconds 00010000:00010000:0.0:1789120802.354918:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a54200/0xb74d2367a830f1b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f1ac expref: 21 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.354929:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970534272:0@lo:104: 00010000:00010000:0.0:1789120802.354938:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946880030800/0xb74d2367a830f189 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f182 expref: 20 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.354946:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f8b40 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970534400:0@lo:104: 00000100:00100000:0.0:1789120802.354970:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789120802.354986:0:6502:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.354995:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970534784 00000100:00100000:0.0:1789120802.354998:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970534784 00000100:00100000:0.0:1789120802.355015:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970534912 00000100:00100000:0.0:1789120802.355017:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970534912 00000100:00100000:0.0:1789120802.355025:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970535040 00000100:00100000:0.0:1789120802.355028:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970535040 00000100:00100000:0.0:1789120802.355036:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970535168 00000100:00100000:0.0:1789120802.355038:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970535168 00000100:00100000:0.0:1789120802.355059:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970535296 00000100:00100000:0.0:1789120802.355062:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970535296 00000100:00100000:0.0:1789120802.355074:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789120802.355079:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b38f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+7:6510:x1876028970534784:12345-0@lo:104: 00010000:00010000:0.0:1789120802.355089:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355129:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120802.355134:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b38f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+7:6510:x1876028970534784:12345-0@lo:104: Request processed in 55us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.355139:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1789120802.355152:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120802.355158:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355164:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887083a00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789120802.355168:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355175:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120802.355182:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120802.355187:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120802.355203:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355209:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120802.355236:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355242:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f166 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f16d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355253:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120802.355255:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120802.355257:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120802.355268:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970535424:0@lo:103: 00000100:00100000:0.0:1789120802.355293:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.355321:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970535424 00000100:00100000:0.0:1789120802.355324:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970535424 00010000:00010000:0.0:1789120802.355337:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946880031600/0xb74d2367a830f16d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f166 expref: 20 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.355354:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789120802.355360:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+20:3644:x1876028970535424:12345-0@lo:103: 00010000:00010000:0.0:1789120802.355367:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120802.355370:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946880031600/0xb74d2367a830f16d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f166 expref: 20 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355378:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946880031600/0xb74d2367a830f16d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f166 expref: 20 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355389:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120802.355413:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b383c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+20:3644:x1876028970535424:12345-0@lo:103: Request processed in 53us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.355419:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789120802.355446:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970535424:0@lo:103: 00010000:00010000:0.0:1789120802.355479:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946880031600/0xb74d2367a830f16d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f166 expref: 19 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.355490:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b392c0 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970534784:0@lo:104: 00000100:00100000:0.0:1789120802.355503:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789120802.355509:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+6:6510:x1876028970534912:12345-0@lo:104: 00010000:00010000:0.0:1789120802.355517:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355553:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120802.355559:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+6:6510:x1876028970534912:12345-0@lo:104: Request processed in 51us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.355565:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1789120802.355589:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120802.355594:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355601:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887082600 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789120802.355604:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355611:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120802.355618:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120802.355623:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120802.355638:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355652:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120802.355663:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355670:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f13c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f143 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355680:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120802.355681:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120802.355683:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120802.355692:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970535552:0@lo:103: 00000100:00100000:0.0:1789120802.355722:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.355749:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970535552 00000100:00100000:0.0:1789120802.355753:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970535552 00010000:00010000:0.0:1789120802.355769:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a54800/0xb74d2367a830f143 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f13c expref: 19 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.355787:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789120802.355792:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+19:3645:x1876028970535552:12345-0@lo:103: 00010000:00010000:0.0:1789120802.355799:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120802.355803:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a54800/0xb74d2367a830f143 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f13c expref: 19 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355810:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a54800/0xb74d2367a830f143 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f13c expref: 19 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.355841:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120802.355868:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835ec850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+19:3645:x1876028970535552:12345-0@lo:103: Request processed in 76us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.355881:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789120802.355927:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970535552:0@lo:103: 00010000:00010000:0.0:1789120802.355950:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a54800/0xb74d2367a830f143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f13c expref: 18 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.355959:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970534912:0@lo:104: 00000100:00100000:0.0:1789120802.355972:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789120802.355978:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+5:6510:x1876028970535040:12345-0@lo:104: 00010000:00010000:0.0:1789120802.355986:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356020:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120802.356025:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+5:6510:x1876028970535040:12345-0@lo:104: Request processed in 49us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.356032:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789120802.356044:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789120802.356050:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:6510:x1876028970535168:12345-0@lo:104: 00010000:00010000:0.0:1789120802.356057:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356090:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789120802.356094:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:6510:x1876028970535168:12345-0@lo:104: Request processed in 45us (1244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.356099:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1789120802.356121:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789120802.356126:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356139:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789120802.356142:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356148:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120802.356154:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120802.356158:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120802.356172:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356177:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120802.356188:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356194:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a55e00/0xb74d2367a830f120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f127 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356204:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120802.356207:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356212:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946880030c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789120802.356214:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356230:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120802.356236:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120802.356241:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120802.356254:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356259:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120802.356264:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356270:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946880030c00/0xb74d2367a830f0e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f0e8 expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356280:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120802.356282:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120802.356284:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120802.356294:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970535808:0@lo:103: 00000100:00100000:0.0:1789120802.356320:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.356340:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120802.356345:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970535680:0@lo:103: 00000100:00100000:0.0:1789120802.356363:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.356388:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970535808 00000100:00100000:0.0:1789120802.356392:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970535808 00010000:00010000:0.0:1789120802.356406:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946880030a00/0xb74d2367a830f0e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f0e1 expref: 18 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.356436:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970535680 00000100:00100000:0.0:1789120802.356440:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970535680 00010000:00010000:0.0:1789120802.356452:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946880030400/0xb74d2367a830f127 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f120 expref: 19 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.356462:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789120802.356467:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+19:3647:x1876028970535808:12345-0@lo:103: 00010000:00010000:0.0:1789120802.356474:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120802.356478:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946880030a00/0xb74d2367a830f0e8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f0e1 expref: 19 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356486:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946880030a00/0xb74d2367a830f0e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f0e1 expref: 19 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356497:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120802.356523:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+19:3647:x1876028970535808:12345-0@lo:103: Request processed in 55us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.356529:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789120802.356540:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789120802.356546:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+18:3647:x1876028970535680:12345-0@lo:103: 00010000:00010000:0.0:1789120802.356553:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120802.356557:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946880030400/0xb74d2367a830f127 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f120 expref: 18 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.356565:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946880030400/0xb74d2367a830f127 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f120 expref: 18 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120802.360164:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789120802.360196:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:6510:x1876028970535296:12345-0@lo:104: 00010000:00010000:2.0:1789120802.360223:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120802.360346:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120802.360352:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:6510:x1876028970535296:12345-0@lo:104: Request processed in 175us (5365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120802.360361:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1789120802.360898:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120802.360909:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.360918:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789120802.360923:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.360933:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120802.360940:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120802.360946:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789120802.361004:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.361012:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120802.361043:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.361050:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f0b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f0be expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.361092:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120802.361095:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120802.361096:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120802.362419:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120802.362480:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b39680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970535040:0@lo:104: 00010000:00010000:1.0:1789120802.362495:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946880030a00/0xb74d2367a830f0e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f0e1 expref: 18 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120802.362511:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3bc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970535168:0@lo:104: 00000100:00100000:1.0:1789120802.362520:0:6510:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:6510:1876028970535296:0@lo:104: 00010000:00010000:0.0:1789120802.362881:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946880030400/0xb74d2367a830f127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f120 expref: 17 pid: 6510 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.363663:0:6510:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.363844:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120802.363880:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970535936:0@lo:103: 00000100:00100000:0.0:1789120802.363966:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.364067:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b39e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970535808:0@lo:103: 00000100:00100000:0.0:1789120802.364093:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789120802.364102:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789120802.364157:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+16:3647:x1876028970535680:12345-0@lo:103: Request processed in 7610us (7792us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.364167:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789120802.364203:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970535680:0@lo:103: 00000100:00100000:0.0:1789120802.364221:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970535936 00000100:00100000:0.0:1789120802.364228:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970535936 00010000:00010000:0.0:1789120802.364263:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946887083200/0xb74d2367a830f0be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f0b7 expref: 16 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.364286:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789120802.364295:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+16:3644:x1876028970535936:12345-0@lo:103: 00010000:00010000:0.0:1789120802.364310:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120802.364315:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946887083200/0xb74d2367a830f0be lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f0b7 expref: 16 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364326:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946887083200/0xb74d2367a830f0be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f0b7 expref: 16 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364343:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887083200/0xb74d2367a830f0be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f0b7 expref: 16 pid: 6512 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364372:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364380:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364394:0:6504:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364402:0:6504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364408:0:6504:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364415:0:6504:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364421:0:6504:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f10800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789120802.364425:0:6504:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364434:0:6504:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364447:0:6504:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.364457:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120802.364485:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+15:3644:x1876028970535936:12345-0@lo:103: Request processed in 191us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.364502:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789120802.364525:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970535936:0@lo:103: 00010000:00010000:1.0:1789120802.365489:0:6510:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.365501:0:6510:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.365507:0:6510:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1c8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789120802.365525:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789120802.370170:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+14:9514:x1876028970534144:12345-0@lo:253: Request processed in 64130us (64704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.370189:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789120802.370336:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3b840 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970534144:0@lo:253: 10000000:01000000:1.0:1789120802.370357:0:9514:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789120802.370361:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789120802.370363:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789120802.370364:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789120802.370379:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1789120802.370380:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789120802.370381:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789120802.370383:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789120802.370385:0:9514:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789120802.370387:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789120802.370388:0:9514:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789120802.370414:0:9514:0:(tgt_mount.c:101:server_register_mount()) register mount ffff946782aee800 from lustre-OST0001 10000000:01000000:1.0:1789120802.370455:0:9514:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789120802.370459:0:9514:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789120802.370470:0:9514:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9468ab900000 local copy 10000000:01000000:1.0:1789120802.370474:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789120802.370525:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.370548:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.370558:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120802.370590:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536064:0@lo:101: 00000100:00100000:1.0:1789120802.370633:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120802.370677:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff946888669b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789120802.371030:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970536064 00000100:00100000:3.0:1789120802.371039:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970536064 00000100:00100000:3.0:1789120802.371247:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789120802.371259:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+14:9514:x1876028970536064:12345-0@lo:101: 00010000:00010000:3.0:1789120802.371276:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120802.371295:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887083600/0xb74d2367a830f1d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f1cf expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.371324:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887083600/0xb74d2367a830f1d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f1cf expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.371346:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887083600/0xb74d2367a830f1d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f1cf expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.371356:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887083600, rc 0) 00000100:00100000:3.0:1789120802.371407:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:9514:x1876028970536064:12345-0@lo:101: Request processed in 151us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120802.371414:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789120802.371480:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536064:0@lo:101: 00010000:00010000:1.0:1789120802.371494:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.371504:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120802.371647:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536192:0@lo:501: 00000100:00100000:1.0:1789120802.371683:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.376968:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970536192 00000100:00100000:0.0:1789120802.378556:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970536192 00000100:00100000:0.0:1789120802.378659:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789120802.378672:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:9514:x1876028970536192:12345-0@lo:501: 00000100:00100000:0.0:1789120802.379162:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:9514:x1876028970536192:12345-0@lo:501: Request processed in 492us (7477us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120802.379172:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789120802.379377:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff946888669b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120802.379413:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f8b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536192:0@lo:501: 10000000:01000000:2.0:1789120802.379468:0:9514:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789120802.379505:0:9514:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789120802.379516:0:9514:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120802.379590:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120802.379600:0:9514:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120802.379671:0:9514:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789120802.379712:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946782aee800 10000000:01000000:2.0:1789120802.379718:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789120802.379783:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789120802.379788:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789120802.379794:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789120802.379799:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789120802.379971:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120802.380703:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120802.380715:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120802.380807:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536320:0@lo:101: 00000100:00100000:2.0:1789120802.381660:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120802.381850:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdda780 going to sleep for 11 seconds 00000100:00100000:1.0:1789120802.382074:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970536320 00000100:00100000:1.0:1789120802.382083:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970536320 00000100:00100000:1.0:1789120802.382144:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789120802.382154:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:9514:x1876028970536320:12345-0@lo:101: 00010000:00010000:1.0:1789120802.382171:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120802.382191:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f1dd expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.382222:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f1dd expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.382235:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f1dd expref: 16 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.382245:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f10800, rc 0) 00000100:00100000:1.0:1789120802.382286:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970536320:12345-0@lo:101: Request processed in 134us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120802.382294:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789120802.382388:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536320:0@lo:101: 00010000:00010000:2.0:1789120802.382404:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120802.382415:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120802.382526:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536448:0@lo:501: 00000100:00100000:2.0:1789120802.382851:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120802.382882:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdda780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120802.382950:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970536448 00000100:00100000:3.0:1789120802.382955:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970536448 00000100:00100000:3.0:1789120802.383056:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789120802.383065:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970536448:12345-0@lo:501: 00000100:00100000:3.0:1789120802.383202:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970536448:12345-0@lo:501: Request processed in 138us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120802.383210:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789120802.383296:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536448:0@lo:501: 00000100:00100000:2.0:1789120802.383326:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536576:0@lo:503: 00000100:00100000:2.0:1789120802.383372:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120802.383396:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdda780 going to sleep for 11 seconds 00000100:00100000:1.0:1789120802.383476:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970536576 00000100:00100000:1.0:1789120802.383481:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970536576 00000100:00100000:1.0:1789120802.383502:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789120802.383509:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970536576:12345-0@lo:503: 00010000:00010000:0.0:1789120802.383683:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120802.383692:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.383702:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789120802.383706:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.383717:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789120802.383792:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120802.383799:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789120802.383841:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.383856:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120802.383877:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.383884:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f1cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xb74d2367a830f1d6 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.383899:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120802.383901:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120802.383902:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120802.383915:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970536704:0@lo:103: 00000100:00100000:0.0:1789120802.383951:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120802.384142:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970536576:12345-0@lo:503: Request processed in 633us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120802.384150:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1789120802.384293:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3b0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536576:0@lo:503: 00000100:00100000:0.0:1789120802.384608:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970536704 00000100:00100000:0.0:1789120802.384613:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970536704 00000100:00100000:0.0:1789120802.384663:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789120802.384672:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+16:3645:x1876028970536704:12345-0@lo:103: 00010000:00010000:0.0:1789120802.384684:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120802.384702:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887083600/0xb74d2367a830f1d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f1cf expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.384717:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120802.385079:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b39e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+15:3645:x1876028970536704:12345-0@lo:103: Request processed in 407us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.385087:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1789120802.385155:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120802.385234:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536832:0@lo:502: 00000100:00100000:3.0:1789120802.385279:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120802.385321:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120802.385398:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970536704:0@lo:103: 00000100:00100000:0.0:1789120802.385455:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970536832 00000100:00100000:0.0:1789120802.385460:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970536832 00000100:00100000:0.0:1789120802.385493:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789120802.385500:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:9514:x1876028970536832:12345-0@lo:502: 00000100:00100000:0.0:1789120802.385628:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+15:9514:x1876028970536832:12345-0@lo:502: Request processed in 128us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.385636:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789120802.385709:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0b40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536832:0@lo:502: 00000040:00080000:1.0:1789120802.386154:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789120802.386181:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789120802.386192:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789120802.386225:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789120802.386239:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789120802.386250:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789120802.386271:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536960:0@lo:502: 00000100:00100000:1.0:1789120802.386307:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120802.386338:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468886690c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120802.386387:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970536960 00000100:00100000:0.0:1789120802.386391:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970536960 00000100:00100000:0.0:1789120802.386421:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789120802.386428:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:9514:x1876028970536960:12345-0@lo:502: 00000100:00100000:0.0:1789120802.386492:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:9514:x1876028970536960:12345-0@lo:502: Request processed in 64us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.386498:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789120802.386544:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fb0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970536960:0@lo:502: 00000040:00080000:0.0:1789120802.386591:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1789120802.386600:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:0.0:1789120802.387959:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789120802.387971:0:9526:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1789120802.388042:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120802.388045:0:9526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1789120802.388055:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789120802.388074:0:9526:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9467821e9a48) 00000020:00000080:0.0:1789120802.388104:0:9526:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789120802.388111:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789120802.388198:0:9526:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946782aee800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1789120802.388208:0:9526:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789120802.388217:0:9526:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb74d2367a830f1f2 00010000:00010000:1.0:1789120802.394313:0:9526:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:1.0:1789120802.395162:0:9526:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1789120802.398163:0:9526:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789120802.399081:0:9526:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1789120802.407073:0:9526:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:1.0:1789120802.407337:0:9526:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:1.0:1789120802.414306:0:9526:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1789120802.416408:0:9526:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789120802.416425:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120802.416434:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120802.416437:0:9526:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789120802.416440:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120802.416444:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120802.416446:0:9526:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789120802.416449:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789120802.416451:0:9526:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789120802.416470:0:9526:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120802.416474:0:9526:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120802.416475:0:9526:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789120802.416478:0:9526:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789120802.416671:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1789120802.416703:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789120802.416737:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.416752:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120802.416761:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946782aee800 from 1 10000000:01000000:1.0:1789120802.416765:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789120802.416815:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.416856:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.416881:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120802.416911:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537088:0@lo:101: 00000100:00100000:1.0:1789120802.417153:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120802.417209:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678213a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789120802.417270:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970537088 00000100:00100000:0.0:1789120802.417278:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970537088 00000100:00100000:0.0:1789120802.417338:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789120802.417347:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:9514:x1876028970537088:12345-0@lo:101: 00010000:00010000:0.0:1789120802.417373:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120802.417389:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c2049e00/0xb74d2367a830f200 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f1f9 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.417420:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c2049e00/0xb74d2367a830f200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f1f9 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.417432:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c2049e00/0xb74d2367a830f200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f1f9 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.417442:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c2049e00, rc 0) 00000100:00100000:0.0:1789120802.417499:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970537088:12345-0@lo:101: Request processed in 151us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.417507:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789120802.417565:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537088:0@lo:101: 00010000:00010000:0.0:1789120802.417593:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.417603:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.417699:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537216:0@lo:501: 00000100:00100000:0.0:1789120802.417742:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.417762:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bbbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120802.417903:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970537216 00000100:00100000:1.0:1789120802.417908:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970537216 00000100:00100000:1.0:1789120802.417943:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789120802.417950:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970537216:12345-0@lo:501: 00000100:00100000:1.0:1789120802.418069:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970537216:12345-0@lo:501: Request processed in 119us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120802.418075:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789120802.418197:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537216:0@lo:501: 00000100:00100000:0.0:1789120802.418227:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537344:0@lo:503: 00000100:00100000:0.0:1789120802.418276:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.418328:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bbbc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120802.418429:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970537344 00000100:00100000:1.0:1789120802.418433:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970537344 00000100:00100000:1.0:1789120802.418463:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789120802.418470:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970537344:12345-0@lo:503: 00000100:00100000:1.0:1789120802.418564:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970537344:12345-0@lo:503: Request processed in 94us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120802.418580:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789120802.418678:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537344:0@lo:503: 00000040:00080000:2.0:1789120802.419138:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789120802.419215:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537472:0@lo:502: 00000100:00100000:2.0:1789120802.419261:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120802.419284:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdda780 going to sleep for 11 seconds 00000100:00100000:1.0:1789120802.419351:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970537472 00000100:00100000:1.0:1789120802.419356:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970537472 00000100:00100000:1.0:1789120802.419389:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789120802.419397:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970537472:12345-0@lo:502: 00000100:00100000:1.0:1789120802.419488:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970537472:12345-0@lo:502: Request processed in 90us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120802.419503:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789120802.419606:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537472:0@lo:502: 00000040:00080000:2.0:1789120802.419906:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789120802.419934:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789120802.419955:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537600:0@lo:502: 00000100:00100000:2.0:1789120802.420142:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120802.420173:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdda780 going to sleep for 11 seconds 00000100:00100000:1.0:1789120802.420233:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970537600 00000100:00100000:1.0:1789120802.420238:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970537600 00000100:00100000:1.0:1789120802.420299:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789120802.420307:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970537600:12345-0@lo:502: 00000100:00100000:1.0:1789120802.420386:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970537600:12345-0@lo:502: Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120802.420393:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789120802.421095:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c38000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537600:0@lo:502: 00000040:00080000:2.0:1789120802.421156:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789120802.421167:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789120802.431293:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120802.431313:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120802.431316:0:9529:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789120802.431326:0:9529:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946782aee800 00000020:00000080:0.0:1789120802.431329:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789120802.431348:0:9529:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120802.431351:0:9529:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120802.431353:0:9529:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789120802.431356:0:9529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789120802.431597:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789120802.431631:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789120802.431714:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.431783:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120802.431905:0:9514:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789120802.431909:0:9514:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946782aee800 10000000:01000000:3.0:1789120802.431913:0:9514:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946782aee800 10000000:01000000:3.0:1789120802.431918:0:9514:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789120802.431926:0:9514:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946782aee800 from 1 10000000:01000000:3.0:1789120802.431929:0:9514:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789120802.432105:0:9514:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.432114:0:9514:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.432128:0:9514:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120802.432157:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537728:0@lo:101: 00000100:00100000:3.0:1789120802.432250:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120802.432346:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120802.432467:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970537728 00000100:00100000:2.0:1789120802.432476:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970537728 00000100:00100000:2.0:1789120802.432536:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789120802.432548:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:9514:x1876028970537728:12345-0@lo:101: 00010000:00010000:2.0:1789120802.432567:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120802.432593:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a54c00/0xb74d2367a830f20e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f207 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120802.432624:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a54c00/0xb74d2367a830f20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f207 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120802.432636:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a54c00/0xb74d2367a830f20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f207 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120802.432645:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54c00, rc 0) 00000100:00100000:2.0:1789120802.432728:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:9514:x1876028970537728:12345-0@lo:101: Request processed in 174us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120802.432736:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789120802.434816:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537728:0@lo:101: 00010000:00010000:3.0:1789120802.434878:0:9514:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.434891:0:9514:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120802.435045:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537856:0@lo:501: 00000100:00100000:3.0:1789120802.435119:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120802.435183:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120802.435364:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970537856 00000100:00100000:0.0:1789120802.435371:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970537856 00000100:00100000:0.0:1789120802.435426:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789120802.435437:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:9514:x1876028970537856:12345-0@lo:501: 00000100:00100000:0.0:1789120802.435605:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:9514:x1876028970537856:12345-0@lo:501: Request processed in 169us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.435614:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789120802.438876:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537856:0@lo:501: 00000100:00100000:3.0:1789120802.438957:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537984:0@lo:503: 00000100:00100000:3.0:1789120802.439202:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120802.439259:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120802.439316:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970537984 00000100:00100000:0.0:1789120802.439324:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970537984 00000100:00100000:0.0:1789120802.439387:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789120802.439398:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:9514:x1876028970537984:12345-0@lo:503: 00000100:00100000:0.0:1789120802.439545:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:9514:x1876028970537984:12345-0@lo:503: Request processed in 147us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.439555:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789120802.441223:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970537984:0@lo:503: 00000040:00080000:3.0:1789120802.441557:0:9514:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789120802.441687:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970538112:0@lo:502: 00000100:00100000:3.0:1789120802.441767:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120802.441815:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120802.441965:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970538112 00000100:00100000:0.0:1789120802.441971:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970538112 00000100:00100000:0.0:1789120802.442030:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789120802.442040:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:9514:x1876028970538112:12345-0@lo:502: 00000100:00100000:0.0:1789120802.442159:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:9514:x1876028970538112:12345-0@lo:502: Request processed in 120us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.442174:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789120802.442311:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970538112:0@lo:502: 00000040:00080000:3.0:1789120802.444215:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789120802.444283:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789120802.444300:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789120802.444311:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789120802.444323:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789120802.444335:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789120802.444346:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789120802.444357:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789120802.444368:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789120802.444380:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789120802.444391:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789120802.444402:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789120802.444416:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789120802.444430:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789120802.444443:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789120802.444455:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789120802.444468:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789120802.444480:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789120802.444507:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789120802.444521:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789120802.444549:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789120802.444565:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789120802.444591:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789120802.444608:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789120802.444621:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1789120802.444635:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1789120802.444650:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1789120802.445259:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1789120802.445300:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1789120802.445317:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1789120802.445331:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1789120802.445344:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1789120802.445356:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1789120802.445369:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1789120802.445383:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1789120802.445396:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1789120802.445408:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:3.0:1789120802.445419:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1789120802.445432:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:3.0:1789120802.445445:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:3.0:1789120802.445458:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:3.0:1789120802.445470:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:3.0:1789120802.445483:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:3.0:1789120802.445496:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:3.0:1789120802.445522:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:3.0:1789120802.446250:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:3.0:1789120802.446317:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970538240:0@lo:502: 00000100:00100000:3.0:1789120802.447176:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120802.447278:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461c00 going to sleep for 11 seconds 00010000:00010000:1.0:1789120802.454541:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120802.456249:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970538240 00000100:00100000:0.0:1789120802.456264:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970538240 00000100:00100000:0.0:1789120802.456347:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789120802.456360:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:9514:x1876028970538240:12345-0@lo:502: 00000100:00100000:0.0:1789120802.457062:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:9514:x1876028970538240:12345-0@lo:502: Request processed in 701us (9886us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.457072:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789120802.459379:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970538240:0@lo:502: 00000040:00080000:0.0:1789120802.460412:0:9514:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:0.0:1789120802.460437:0:9514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:0.0:1789120802.463590:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789120802.463615:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9467821eb490) 00000020:00000080:0.0:1789120802.463647:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:0.0:1789120802.463761:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946782aee800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789120802.463766:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946782aee800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789120802.463768:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946782aee800 3 00010000:00080000:0.0:1789120802.463806:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946783263000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789120802.466111:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:0.0:1789120802.466365:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789120802.466413:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789120802.466429:0:9531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb74d2367a830f21c 00000100:00080000:0.0:1789120802.466444:0:9531:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789120802.466450:0:9531:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff946783263000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789120802.466494:0:9531:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946782b383c0 x1876028970538368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789120802.466522:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789120802.466675:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970538624:0@lo:400: 00000100:00100000:0.0:1789120802.466793:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.466880:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970539136:0@lo:400: 00000100:00100000:0.0:1789120802.466912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.466940:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789120802.466946:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970538496:0@lo:400: 00000100:00100000:0.0:1789120802.466971:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.466987:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970539008:0@lo:400: 00000100:00100000:0.0:1789120802.467007:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.467033:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970538752:0@lo:400: 00000100:00100000:0.0:1789120802.467058:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.467074:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970539264:0@lo:400: 00000100:00100000:0.0:1789120802.467110:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.467134:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789120802.467140:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970538880:0@lo:400: 00000100:00100000:0.0:1789120802.467165:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.467182:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970539392:0@lo:400: 00000100:00100000:0.0:1789120802.467203:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.467242:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970538624 00000100:00100000:0.0:1789120802.467250:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970538624 00000100:00100000:0.0:1789120802.467291:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970538880 00000100:00100000:0.0:1789120802.467293:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970538880 00000100:00100000:0.0:1789120802.467309:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789120802.467318:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970538624:12345-0@lo:400: 00000100:00100000:0.0:1789120802.467386:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970538624:12345-0@lo:400: Request processed in 68us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.467394:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789120802.467419:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789120802.467426:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970538880:12345-0@lo:400: 00000100:00100000:0.0:1789120802.467472:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970538880:12345-0@lo:400: Request processed in 46us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.467478:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789120802.467498:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970539136 00000100:00100000:0.0:1789120802.467501:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970539136 00000100:00100000:0.0:1789120802.467535:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970538496 00000100:00100000:0.0:1789120802.467539:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970538496 00000100:00100000:0.0:1789120802.467550:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970539008 00000100:00100000:0.0:1789120802.467552:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970539008 00000100:00100000:0.0:1789120802.467564:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970538752 00000100:00100000:0.0:1789120802.467566:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970538752 00000100:00100000:3.0:1789120802.469568:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789120802.469599:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970539136:12345-0@lo:400: 00000100:00100000:3.0:1789120802.469686:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970539136:12345-0@lo:400: Request processed in 96us (2772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120802.469693:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789120802.469718:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789120802.469725:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970538496:12345-0@lo:400: 00000100:00100000:3.0:1789120802.469752:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970538496:12345-0@lo:400: Request processed in 28us (2780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120802.469758:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789120802.469769:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789120802.469775:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970539008:12345-0@lo:400: 00000100:00100000:3.0:1789120802.469802:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970539008:12345-0@lo:400: Request processed in 27us (2793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120802.469808:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789120802.470036:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970538368:0@lo:38: 00000100:00100000:2.0:1789120802.470089:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120802.473004:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970538368 00000100:00100000:3.0:1789120802.473021:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970538368 00000100:00100000:3.0:1789120802.473082:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789120802.473092:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876028970538368:12345-0@lo:38: 00010000:00080000:3.0:1789120802.473127:0:6520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:3.0:1789120802.473171:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb74d2367a830f223 00000004:00100000:3.0:1789120802.473194:0:6520:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789120802.473241:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9468b9c33000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120802.473341:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876028970538368:12345-0@lo:38: Request processed in 250us (3251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120802.473349:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789120802.474211:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b383c0 x1876028970538368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120802.474225:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789120802.474235:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1789120802.474245:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789120802.474250:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789120802.474253:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783263000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789120802.474260:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970538368:0@lo:38: 00000100:00100000:1.0:1789120802.475360:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970539264 00000100:00100000:1.0:1789120802.475371:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970539264 00000100:00100000:1.0:1789120802.475433:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970539392 00000100:00100000:1.0:1789120802.475436:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970539392 00000100:00100000:1.0:1789120802.475462:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789120802.475471:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970539264:12345-0@lo:400: 00000100:00100000:1.0:1789120802.475584:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839eed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970539264:12345-0@lo:400: Request processed in 113us (8472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120802.475592:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789120802.475627:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789120802.475633:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970539392:12345-0@lo:400: 00000100:00100000:1.0:1789120802.475679:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970539392:12345-0@lo:400: Request processed in 46us (8475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120802.475686:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789120802.478699:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789120802.478713:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120802.478717:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789120802.478804:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970538880:0@lo:400: 00010000:00080000:0.0:1789120802.478851:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893a7f480 x1876028970539392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120802.478865:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970539392:0@lo:400: 00010000:00080000:0.0:1789120802.478880:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b392c0 x1876028970539264/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120802.478889:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970539264:0@lo:400: 00010000:00080000:0.0:1789120802.478939:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b3a1c0 x1876028970538496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120802.478949:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970538496:0@lo:400: 00010000:00080000:0.0:1789120802.478961:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b39680 x1876028970539008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120802.478983:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970539008:0@lo:400: 00000100:00100000:0.0:1789120802.479000:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970538624:0@lo:400: 00010000:00080000:0.0:1789120802.479012:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b3b480 x1876028970539136/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120802.479021:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970539136:0@lo:400: 00000100:00100000:0.0:1789120802.479104:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789120802.479119:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970538752:12345-0@lo:400: 00000100:00100000:0.0:1789120802.479227:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970538752:12345-0@lo:400: Request processed in 113us (12168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.479236:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1789120802.479267:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b38000 x1876028970538752/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120802.479276:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970538752:0@lo:400: 00000020:01000004:1.0:1789120802.479930:0:9531:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789120802.479949:0:9531:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff946782858000) 00000020:00000080:1.0:1789120802.479978:0:9531:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:1.0:1789120802.480086:0:9531:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946782aee800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789120802.480090:0:9531:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946782aee800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789120802.480094:0:9531:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946782aee800 3 00010000:00080000:1.0:1789120802.480148:0:9531:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9467839f9800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789120802.482224:0:9531:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:1.0:1789120802.482454:0:9531:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1789120802.482500:0:9531:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789120802.482513:0:9531:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb74d2367a830f231 00000100:00080000:1.0:1789120802.482525:0:9531:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789120802.482530:0:9531:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9467839f9800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789120802.482582:0:9531:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9467831fa940 x1876028970539520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789120802.482641:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876028970539520:0@lo:38: 00000100:00100000:1.0:1789120802.482745:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789120802.482843:0:9531:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:3.0:1789120802.485974:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970539520 00000100:00100000:3.0:1789120802.485989:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970539520 00000100:00100000:3.0:1789120802.486047:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789120802.486057:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876028970539520:12345-0@lo:38: 00010000:00080000:3.0:1789120802.486097:0:6520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 252 last 0 00000020:00000080:3.0:1789120802.486154:0:6520:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb74d2367a830f238 00000004:00100000:3.0:1789120802.486176:0:6520:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789120802.486224:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9468b9c30800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120802.486341:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876028970539520:12345-0@lo:38: Request processed in 283us (3594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120802.486349:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789120802.486415:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467831fa940 x1876028970539520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789120812 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120802.486429:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789120802.486439:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789120802.486448:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789120802.486453:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789120802.486456:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9467839f9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789120802.486463:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876028970539520:0@lo:38: 00000100:00100000:3.0:1789120802.486566:0:9533:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1876028970539648:0@lo:901: 00000100:00100000:3.0:1789120802.486636:0:9533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120802.486673:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970539648 00000100:00100000:3.0:1789120802.486678:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970539648 00000100:00100000:3.0:1789120802.486724:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789120802.486730:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1876028970539648:12345-0@lo:901: 00000100:00100000:3.0:1789120802.486841:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:9533:x1876028970539648:12345-0@lo:901: Request processed in 88us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120802.486855:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789120802.486875:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120802.486891:0:9533:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468918016c0 going to sleep for 11 seconds 00010000:00080000:3.0:1789120802.486905:0:9533:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99b0000 x1876028970539648/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789120818 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120802.486919:0:9533:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9533:1876028970539648:0@lo:901: 00000040:00080000:2.0:1789120802.487665:0:9531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:1.0:1789120802.487870:0:9514:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:1.0:1789120802.487910:0:9514:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789120802.487931:0:9514:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120802.487955:0:9514:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789120802.488008:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789120802.488010:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789120802.488012:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789120802.488013:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789120802.488014:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789120802.488016:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789120802.488018:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789120802.488019:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789120802.488021:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789120802.488023:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789120802.488024:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789120802.488030:0:9514:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789120802.488032:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789120802.488034:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789120802.488035:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789120802.488036:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789120802.488037:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789120802.488038:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789120802.488039:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789120802.488040:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789120802.488041:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789120802.488042:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789120802.488043:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789120802.488061:0:9514:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789120802.488074:0:9514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970539776:0@lo:253: 00000100:00100000:1.0:1789120802.488131:0:9514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120802.488167:0:9514:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120802.488190:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970539776 00000100:00100000:1.0:1789120802.488195:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970539776 00000100:00100000:1.0:1789120802.488229:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789120802.488236:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:9514:x1876028970539776:12345-0@lo:253: 20000000:01000000:1.0:1789120802.488269:0:6510:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789120802.488288:0:6510:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1789120802.496975:0:6510:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789120802.496999:0:6510:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789120802.497341:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:9514:x1876028970539776:12345-0@lo:253: Request processed in 9098us (9202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120802.497355:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 20000000:01000000:3.0:1789120802.497460:0:6534:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789120802.497467:0:6534:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789120802.497503:0:6534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.497521:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946880031c00/0xb74d2367a830f135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f12e expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.497538:0:6534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946887082a00/0xb74d2367a830f17b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f174 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.497547:0:6534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.497606:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946887082a00/0xb74d2367a830f17b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f174 expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.497622:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946887082a00/0xb74d2367a830f17b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f174 expref: 16 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120802.497637:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970539904:0@lo:104: 00000100:00100000:3.0:1789120802.497694:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120802.497917:0:6534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946880031c00/0xb74d2367a830f135 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f12e expref: 16 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.497931:0:6534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946880031c00/0xb74d2367a830f135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f12e expref: 16 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120802.497939:0:6534:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970540032:0@lo:104: 00000100:00100000:3.0:1789120802.497979:0:6534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120802.498001:0:6534:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468918016c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120802.498023:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970539904 00000100:00100000:3.0:1789120802.498031:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970539904 00000100:00100000:3.0:1789120802.498071:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970540032 00000100:00100000:3.0:1789120802.498074:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970540032 00000100:00100000:3.0:1789120802.498087:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789120802.498095:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:6534:x1876028970539904:12345-0@lo:104: 00010000:00010000:3.0:1789120802.498110:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498158:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120802.498164:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:6534:x1876028970539904:12345-0@lo:104: Request processed in 70us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120802.498170:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789120802.498187:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789120802.498194:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:6534:x1876028970540032:12345-0@lo:104: 00010000:00010000:3.0:1789120802.498202:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498238:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789120802.498244:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:6534:x1876028970540032:12345-0@lo:104: Request processed in 51us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120802.498257:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:3.0:1789120802.498276:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789120802.498282:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498290:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946880030000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789120802.498295:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498304:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120802.498311:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120802.498317:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789120802.498362:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498369:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120802.498390:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498396:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946880030000/0xb74d2367a830f174 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f17b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498407:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120802.498410:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498425:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789120802.498428:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498434:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120802.498439:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120802.498444:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789120802.498458:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498463:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120802.498469:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498475:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468a2f11400/0xb74d2367a830f12e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f135 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498489:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120802.498491:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120802.498493:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120802.498499:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120802.498512:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970540288:0@lo:103: 00000100:00100000:3.0:1789120802.498556:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120802.498589:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120802.498595:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970540160:0@lo:103: 00000100:00100000:3.0:1789120802.498625:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120802.498648:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970540288 00000100:00100000:0.0:1789120802.498653:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970540288 00000100:00100000:3.0:1789120802.498665:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970540160 00000100:00100000:3.0:1789120802.498668:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970540160 00010000:00010000:0.0:1789120802.498675:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946880031c00/0xb74d2367a830f135 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f12e expref: 18 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.498680:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946887082a00/0xb74d2367a830f17b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f174 expref: 18 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120802.498698:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789120802.498710:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+18:3647:x1876028970540288:12345-0@lo:103: 00010000:00010000:0.0:1789120802.498721:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120802.498727:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946880031c00/0xb74d2367a830f135 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f12e expref: 18 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.498746:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946880031c00/0xb74d2367a830f135 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f12e expref: 18 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120802.498785:0:9514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f92c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:03a1864a-46e4-4762-8a00-3ced97b06903:9514:1876028970539776:0@lo:253: 10000000:01000000:1.0:1789120802.498799:0:9514:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789120802.498802:0:9514:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789120802.498804:0:9514:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789120802.498806:0:9514:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789120802.498807:0:9514:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789120802.498808:0:9514:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789120802.498810:0:9514:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789120802.498811:0:9514:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789120802.498814:0:9514:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789120802.498815:0:9514:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789120802.498817:0:9514:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789120802.498834:0:9514:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00010000:00010000:0.0:1789120802.498843:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:02000000:1.0:1789120802.498854:0:9514:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789120802.498876:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+18:3647:x1876028970540288:12345-0@lo:103: Request processed in 168us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.498882:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789120802.498896:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789120802.498902:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+17:3647:x1876028970540160:12345-0@lo:103: 00010000:00010000:0.0:1789120802.498909:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120802.498913:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946887082a00/0xb74d2367a830f17b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f174 expref: 17 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.498923:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946887082a00/0xb74d2367a830f17b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f174 expref: 17 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.498935:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.498943:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789120802.498956:0:9525:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.016309101s 00010000:00010000:0.0:1789120802.498960:0:9525:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.498967:0:9525:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.499334:0:9525:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.499348:0:9525:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.499371:0:9525:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887082e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789120802.499376:0:9525:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.499397:0:9525:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.499408:0:9525:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120802.499438:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120802.499499:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcde00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+17:3647:x1876028970540160:12345-0@lo:103: Request processed in 597us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120802.499525:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789120802.503800:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970540160:0@lo:103: 00000100:00100000:3.0:1789120802.503837:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970540288:0@lo:103: 00010000:00010000:3.0:1789120802.503893:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887082a00/0xb74d2367a830f17b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f174 expref: 16 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120802.503916:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970539904:0@lo:104: 00010000:00010000:3.0:1789120802.503929:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946880031c00/0xb74d2367a830f135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f12e expref: 15 pid: 6513 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120802.503938:0:6534:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6534:1876028970540032:0@lo:104: 00010000:00010000:3.0:1789120802.503963:0:6534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.503975:0:6534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.503982:0:6534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120802.503988:0:6534:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887082e00/0xb74d2367a830f23f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1789120802.519213:0:9514:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1789120802.519450:0:9514:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1789120802.519684:0:9514:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1789120802.520258:0:9514:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:1.0:1789120802.522132:0:9514:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1789120802.522381:0:9514:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1789120802.525110:0:9514:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789120802.538762:0:9514:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789120802.538780:0:9514:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789120802.538845:0:9514:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789120802.538908:0:9514:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789120802.538934:0:9514:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789120802.538970:0:9514:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789120802.544224:0:9514:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789120802.544447:0:9514:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1789120803.218706:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120803.218746:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970540416:0@lo:13: 00000100:00100000:1.0:1789120803.218877:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120803.219922:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970540416 00000100:00100000:0.0:1789120803.219932:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970540416 00000100:00100000:0.0:1789120803.220000:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789120803.220011:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970540416:12345-0@lo:13: 00002000:00000024:0.0:1789120803.220050:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120803.220142:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970540416:12345-0@lo:13: Request processed in 133us (1266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120803.220150:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789120803.220585:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120803.220601:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970540544:0@lo:13: 00000100:00100000:1.0:1789120803.220636:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120803.220777:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970540544 00000100:00100000:3.0:1789120803.220800:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970540544 00000100:00100000:3.0:1789120803.220855:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789120803.220862:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970540544:12345-0@lo:13: 00002000:00000024:3.0:1789120803.220874:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120803.220908:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970540544:12345-0@lo:13: Request processed in 47us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120803.220915:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1789120803.221031:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ed680 x1876028970540416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120803.221065:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970540416:0@lo:13: 00010000:00080000:1.0:1789120803.221365:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ee580 x1876028970540544/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120803.221392:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970540544:0@lo:13: 00000020:00000004:1.0:1789120803.468689:0:9588:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789120803.468971:0:9588:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789120803.481909:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120804.498270:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120805.528058:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120806.290003:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789120806.290040:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970540672:0@lo:41: 00000100:00100000:2.0:1789120806.290132:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120806.290232:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970540672 00000100:00100000:2.0:1789120806.290242:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970540672 00000100:00100000:2.0:1789120806.290299:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789120806.290309:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970540672:12345-0@lo:41: 00000004:00000024:2.0:1789120806.290367:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1789120806.290425:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970540672:12345-0@lo:41: Request processed in 117us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120806.290434:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789120806.290501:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970540672:0@lo:41: 00000100:00100000:1.0:1789120806.290876:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120806.290889:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970540800:0@lo:41: 00000100:00100000:1.0:1789120806.290926:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120806.290960:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970540800 00000100:00100000:1.0:1789120806.290965:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970540800 00000100:00100000:1.0:1789120806.290990:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789120806.290997:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970540800:12345-0@lo:41: 00000004:00000024:1.0:1789120806.291016:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:1.0:1789120806.291051:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970540800:12345-0@lo:41: Request processed in 55us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120806.291059:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789120806.291090:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970540800:0@lo:41: 00010000:00010000:3.0:1789120806.545997:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120807.570609:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120807.826042:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970541056:0@lo:400: 00000100:00100000:0.0:1789120807.826131:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120807.826199:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970541568:0@lo:400: 00000100:00100000:0.0:1789120807.826228:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120807.826250:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970542080:0@lo:400: 00000100:00100000:0.0:1789120807.826272:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120807.826309:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789120807.826315:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970540928:0@lo:400: 00000100:00100000:0.0:1789120807.826345:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120807.826363:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970541440:0@lo:400: 00000100:00100000:0.0:1789120807.826400:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120807.826418:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970541952:0@lo:400: 00000100:00100000:0.0:1789120807.826439:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120807.826464:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970541184:0@lo:400: 00000100:00100000:0.0:1789120807.826484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120807.826511:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970541696:0@lo:400: 00000100:00100000:0.0:1789120807.826539:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120807.826552:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970542208:0@lo:400: 00000100:00100000:0.0:1789120807.826571:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120807.826581:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789120807.826586:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970541312:0@lo:400: 00000100:00100000:0.0:1789120807.826602:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120807.826609:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970541824:0@lo:400: 00000100:00100000:0.0:1789120807.826624:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120807.826655:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970541056 00000100:00100000:0.0:1789120807.826662:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970541056 00000100:00100000:0.0:1789120807.826877:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970541568 00000100:00100000:0.0:1789120807.826881:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970541568 00000100:00100000:0.0:1789120807.826908:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970542080 00000100:00100000:0.0:1789120807.826916:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970542080 00000100:00100000:0.0:1789120807.826930:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970541696 00000100:00100000:0.0:1789120807.826931:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970541696 00000100:00100000:0.0:1789120807.826942:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970542208 00000100:00100000:0.0:1789120807.826944:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970542208 00000100:00100000:0.0:1789120807.826953:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970541312 00000100:00100000:0.0:1789120807.826954:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970541312 00000100:00100000:0.0:1789120807.826968:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789120807.826976:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970541056:12345-0@lo:400: 00000100:00100000:0.0:1789120807.827034:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970541056:12345-0@lo:400: Request processed in 58us (903us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.827042:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789120807.827059:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789120807.827064:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970541568:12345-0@lo:400: 00000100:00100000:0.0:1789120807.827086:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970541568:12345-0@lo:400: Request processed in 22us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.827091:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789120807.827100:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789120807.827105:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970542080:12345-0@lo:400: 00000100:00100000:0.0:1789120807.827124:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970542080:12345-0@lo:400: Request processed in 20us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.827130:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789120807.827138:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789120807.827142:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970541696:12345-0@lo:400: 00000100:00100000:0.0:1789120807.827165:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970541696:12345-0@lo:400: Request processed in 23us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.827170:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789120807.827179:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789120807.827189:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970542208:12345-0@lo:400: 00000100:00100000:0.0:1789120807.827212:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970542208:12345-0@lo:400: Request processed in 23us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.827217:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789120807.827226:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789120807.827231:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970541312:12345-0@lo:400: 00000100:00100000:0.0:1789120807.827250:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970541312:12345-0@lo:400: Request processed in 19us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.827255:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789120807.827281:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970540928 00000100:00100000:0.0:1789120807.827284:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970540928 00000100:00100000:0.0:1789120807.827321:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789120807.827328:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:3645:x1876028970540928:12345-0@lo:400: 00000100:00100000:0.0:1789120807.827354:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+15:3645:x1876028970540928:12345-0@lo:400: Request processed in 28us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.827360:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789120807.827388:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970541440 00000100:00100000:0.0:1789120807.827391:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970541440 00000100:00100000:0.0:1789120807.827406:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970541184 00000100:00100000:0.0:1789120807.827407:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970541184 00000100:00100000:0.0:1789120807.827418:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789120807.827423:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970541440:12345-0@lo:400: 00000100:00100000:0.0:1789120807.827451:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970541440:12345-0@lo:400: Request processed in 28us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.827457:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789120807.827465:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789120807.827470:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970541184:12345-0@lo:400: 00000100:00100000:0.0:1789120807.827615:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970541184:12345-0@lo:400: Request processed in 144us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.827621:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789120807.827640:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970541952 00000100:00100000:0.0:1789120807.827644:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970541952 00000100:00100000:0.0:1789120807.827735:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970541824 00000100:00100000:0.0:1789120807.827739:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970541824 00000100:00100000:0.0:1789120807.827759:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120807.827765:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970541952:12345-0@lo:400: 00000100:00100000:0.0:1789120807.827794:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970541952:12345-0@lo:400: Request processed in 30us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.827800:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789120807.827809:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789120807.827814:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970541824:12345-0@lo:400: 00000100:00100000:0.0:1789120807.827859:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970541824:12345-0@lo:400: Request processed in 44us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120807.827864:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1789120807.827891:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789120807.827897:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789120807.827899:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789120807.827938:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ec780 x1876028970541312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120807.827954:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970541312:0@lo:400: 00010000:00080000:0.0:1789120807.827965:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ee940 x1876028970541824/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120807.827973:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970541824:0@lo:400: 00000100:00100000:0.0:1789120807.827991:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970541184:0@lo:400: 00010000:00080000:0.0:1789120807.828000:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ec000 x1876028970541696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120807.828007:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970541696:0@lo:400: 00010000:00080000:0.0:1789120807.828016:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ede00 x1876028970542208/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120807.828023:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ede00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970542208:0@lo:400: 00000100:00100000:0.0:1789120807.828059:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839eda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970540928:0@lo:400: 00000100:00100000:0.0:1789120807.828069:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970541440:0@lo:400: 00010000:00080000:0.0:1789120807.828077:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ecf00 x1876028970541952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120807.828085:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970541952:0@lo:400: 00010000:00080000:0.0:1789120807.828095:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ec3c0 x1876028970541056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120807.828102:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970541056:0@lo:400: 00010000:00080000:0.0:1789120807.828111:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ef0c0 x1876028970541568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120807.828119:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970541568:0@lo:400: 00010000:00080000:0.0:1789120807.828128:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ed2c0 x1876028970542080/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120823 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120807.828135:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970542080:0@lo:400: 00000100:00100000:1.0:1789120808.337955:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120808.337981:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970542336:0@lo:13: 00000100:00100000:1.0:1789120808.338065:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.338272:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970542336 00000100:00100000:3.0:1789120808.338280:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970542336 00000100:00100000:3.0:1789120808.338345:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789120808.338356:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970542336:12345-0@lo:13: 00002000:00000024:3.0:1789120808.338386:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120808.338437:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970542336:12345-0@lo:13: Request processed in 83us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.338444:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789120808.338699:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467831fb480 x1876028970542336/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120808.338719:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970542336:0@lo:13: 00000100:00100000:3.0:1789120808.338971:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120808.338982:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970542464:0@lo:13: 00000100:00100000:3.0:1789120808.339028:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120808.339154:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970542464 00000100:00100000:1.0:1789120808.339159:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970542464 00000100:00100000:1.0:1789120808.339194:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789120808.339202:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970542464:12345-0@lo:13: 00002000:00000024:1.0:1789120808.339214:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120808.339247:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970542464:12345-0@lo:13: Request processed in 46us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.339268:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:3.0:1789120808.339440:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467831fa580 x1876028970542464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120808.339454:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970542464:0@lo:13: 10000000:01000000:1.0:1789120808.339755:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789120808.339760:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9468b9991000 from 39 10000000:01000000:1.0:1789120808.339764:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789120808.339795:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120808.339806:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120808.339816:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120808.339849:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970542592:0@lo:101: 00000100:00100000:1.0:1789120808.339887:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120808.339913:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789120808.339928:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970542592 00000100:00100000:1.0:1789120808.339932:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970542592 00000100:00100000:1.0:1789120808.339961:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789120808.339968:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970542592:12345-0@lo:101: 00010000:00010000:1.0:1789120808.339978:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120808.339992:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f24d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f246 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120808.340013:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f246 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120808.340239:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f246 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120808.340260:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f11400, rc 0) 00000100:00100000:1.0:1789120808.340396:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970542592:12345-0@lo:101: Request processed in 428us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.340403:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789120808.340743:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fbc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970542592:0@lo:101: 00010000:00010000:3.0:1789120808.340760:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.340768:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120808.340862:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970542720:0@lo:501: 00000100:00100000:3.0:1789120808.340895:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.340928:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7840 going to sleep for 11 seconds 00000100:00100000:1.0:1789120808.340987:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970542720 00000100:00100000:1.0:1789120808.340992:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970542720 00000100:00100000:1.0:1789120808.341035:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789120808.341043:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970542720:12345-0@lo:501: 00000100:00100000:1.0:1789120808.341159:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970542720:12345-0@lo:501: Request processed in 116us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.341166:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789120808.341304:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970542720:0@lo:501: 00000100:00100000:3.0:1789120808.341334:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970542848:0@lo:503: 00000100:00100000:3.0:1789120808.341378:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.341406:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7840 going to sleep for 11 seconds 00000100:00100000:1.0:1789120808.341580:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970542848 00000100:00100000:1.0:1789120808.341585:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970542848 00000100:00100000:1.0:1789120808.341615:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789120808.341621:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970542848:12345-0@lo:503: 00000100:00100000:1.0:1789120808.341696:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970542848:12345-0@lo:503: Request processed in 74us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.341703:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789120808.341780:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970542848:0@lo:503: 00000100:00100000:3.0:1789120808.343112:0:9810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9810:1876028970542976:0@lo:502: 00000100:00100000:3.0:1789120808.343186:0:9810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.343312:0:9810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120808.345691:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970542976 00000100:00100000:1.0:1789120808.345704:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970542976 00000100:00100000:1.0:1789120808.345773:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789120808.345785:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:9810:x1876028970542976:12345-0@lo:502: 00000100:00100000:1.0:1789120808.345982:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:9810:x1876028970542976:12345-0@lo:502: Request processed in 199us (2795us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.345991:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1789120808.346197:0:9810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9810:1876028970542976:0@lo:502: 00000100:00100000:3.0:1789120808.346266:0:9810:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9810:1876028970543104:0@lo:502: 00000100:00100000:3.0:1789120808.346397:0:9810:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.346438:0:9810:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120808.346569:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970543104 00000100:00100000:1.0:1789120808.346574:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970543104 00000100:00100000:1.0:1789120808.346610:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789120808.346618:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9810:x1876028970543104:12345-0@lo:502: 00000100:00100000:1.0:1789120808.346692:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:9810:x1876028970543104:12345-0@lo:502: Request processed in 75us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.346699:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1789120808.346853:0:9810:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9810:1876028970543104:0@lo:502: 00000040:00080000:3.0:1789120808.346875:0:9810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:1.0:1789120808.350990:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:1.0:1789120808.351109:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789120808.351121:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120808.351135:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120808.351146:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789120808.351149:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1789120808.351151:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789120808.351192:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120808.351200:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120808.351212:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120808.351235:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970543232:0@lo:101: 00000100:00100000:1.0:1789120808.351380:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120808.351460:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a480 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.351710:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970543232 00000100:00100000:3.0:1789120808.351718:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970543232 00000100:00100000:3.0:1789120808.351769:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789120808.351779:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970543232:12345-0@lo:101: 00010000:00010000:3.0:1789120808.351792:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120808.351805:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887082e00/0xb74d2367a830f25b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f254 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.351848:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887082e00/0xb74d2367a830f25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f254 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.351858:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887082e00/0xb74d2367a830f25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f254 expref: 17 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.351866:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082e00, rc 0) 00000100:00100000:3.0:1789120808.351921:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970543232:12345-0@lo:101: Request processed in 143us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.351928:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789120808.352029:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970543232:0@lo:101: 00010000:00010000:2.0:1789120808.352045:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.352054:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120808.352122:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970543360:0@lo:501: 00000100:00100000:2.0:1789120808.352151:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.352181:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9d82a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.352305:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970543360 00000100:00100000:3.0:1789120808.352310:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970543360 00000100:00100000:3.0:1789120808.352341:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789120808.352349:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970543360:12345-0@lo:501: 00000100:00100000:3.0:1789120808.352610:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970543360:12345-0@lo:501: Request processed in 114us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.352619:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789120808.352650:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970543360:0@lo:501: 00000100:00100000:3.0:1789120808.352679:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970543488:0@lo:503: 00000100:00100000:3.0:1789120808.352729:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.352747:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688357bc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.352757:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970543488 00000100:00100000:3.0:1789120808.352760:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970543488 00000100:00100000:3.0:1789120808.352774:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789120808.352779:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970543488:12345-0@lo:503: 00000100:00100000:3.0:1789120808.352871:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970543488:12345-0@lo:503: Request processed in 90us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.352878:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789120808.352912:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970543488:0@lo:503: 00000100:00100000:2.0:1789120808.357807:0:9811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c392c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9811:1876028970543616:0@lo:502: 00000100:00100000:2.0:1789120808.357914:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.357962:0:9811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9d82180 going to sleep for 11 seconds 00000100:00100000:0.0:1789120808.358239:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970543616 00000100:00100000:0.0:1789120808.358249:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970543616 00000100:00100000:2.0:1789120808.358394:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789120808.358405:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:9811:x1876028970543616:12345-0@lo:502: 00000100:00100000:2.0:1789120808.358561:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:9811:x1876028970543616:12345-0@lo:502: Request processed in 158us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.358568:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789120808.358768:0:9811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c392c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9811:1876028970543616:0@lo:502: 00000020:01000000:1.0:1789120808.358798:0:9811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120808.358808:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120808.358810:0:9811:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789120808.358817:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789120808.358835:0:9811:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789120808.358858:0:9811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9811:1876028970543744:0@lo:502: 00000100:00100000:1.0:1789120808.358899:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120808.358931:0:9811:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a480 going to sleep for 11 seconds 00000100:00100000:0.0:1789120808.358986:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970543744 00000100:00100000:0.0:1789120808.358990:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970543744 00000100:00100000:0.0:1789120808.359102:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789120808.359111:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+17:9811:x1876028970543744:12345-0@lo:502: 00000100:00100000:0.0:1789120808.359201:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+17:9811:x1876028970543744:12345-0@lo:502: Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120808.359208:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789120808.359286:0:9811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9811:1876028970543744:0@lo:502: 00000020:01000000:1.0:1789120808.359389:0:9811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120808.359394:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120808.359395:0:9811:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789120808.359398:0:9811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1789120808.359634:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1789120808.359659:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789120808.359669:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120808.359681:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120808.359691:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789120808.359693:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946883582800 from 39 10000000:01000000:0.0:1789120808.359696:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789120808.359724:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120808.359733:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120808.359742:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120808.359757:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970543872:0@lo:101: 00000100:00100000:0.0:1789120808.359800:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120808.359858:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.359923:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970543872 00000100:00100000:2.0:1789120808.359928:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970543872 00000100:00100000:2.0:1789120808.359965:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789120808.359979:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970543872:12345-0@lo:101: 00010000:00010000:2.0:1789120808.359990:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120808.360002:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55200/0xb74d2367a830f269 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f262 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.360110:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55200/0xb74d2367a830f269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f262 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.360123:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55200/0xb74d2367a830f269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f262 expref: 18 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.360132:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55200, rc 0) 00000100:00100000:2.0:1789120808.360168:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970543872:12345-0@lo:101: Request processed in 190us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.360175:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789120808.360210:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24b40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970543872:0@lo:101: 00010000:00010000:2.0:1789120808.360222:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.360232:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120808.360428:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544000:0@lo:501: 00000100:00100000:2.0:1789120808.360458:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.360572:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bbba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.360587:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970544000 00000100:00100000:2.0:1789120808.360591:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970544000 00000100:00100000:2.0:1789120808.360611:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789120808.360617:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970544000:12345-0@lo:501: 00000100:00100000:2.0:1789120808.360728:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970544000:12345-0@lo:501: Request processed in 110us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.360735:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789120808.360782:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544000:0@lo:501: 00000100:00100000:2.0:1789120808.360810:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544128:0@lo:503: 00000100:00100000:2.0:1789120808.360877:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.360890:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bbba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.360901:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970544128 00000100:00100000:2.0:1789120808.360905:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970544128 00000100:00100000:2.0:1789120808.360922:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789120808.360927:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970544128:12345-0@lo:503: 00000100:00100000:2.0:1789120808.361002:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970544128:12345-0@lo:503: Request processed in 73us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.361009:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789120808.361260:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544128:0@lo:503: 00000100:00100000:0.0:1789120808.365547:0:9812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9812:1876028970544256:0@lo:502: 00000100:00100000:0.0:1789120808.365638:0:9812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120808.365733:0:9812:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.366254:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970544256 00000100:00100000:2.0:1789120808.366262:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970544256 00000100:00100000:2.0:1789120808.366399:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789120808.366410:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:9812:x1876028970544256:12345-0@lo:502: 00000100:00100000:2.0:1789120808.366743:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:9812:x1876028970544256:12345-0@lo:502: Request processed in 334us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.366751:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789120808.367759:0:9812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9812:1876028970544256:0@lo:502: 00000100:00100000:1.0:1789120808.367855:0:9812:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9812:1876028970544384:0@lo:502: 00000100:00100000:1.0:1789120808.367909:0:9812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120808.367944:0:9812:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.368035:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970544384 00000100:00100000:2.0:1789120808.368041:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970544384 00000100:00100000:2.0:1789120808.368082:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789120808.368091:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:9812:x1876028970544384:12345-0@lo:502: 00000100:00100000:2.0:1789120808.368194:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:9812:x1876028970544384:12345-0@lo:502: Request processed in 104us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.368202:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789120808.368420:0:9812:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9812:1876028970544384:0@lo:502: 00000040:00080000:1.0:1789120808.368442:0:9812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1789120808.368675:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1789120808.368699:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789120808.368710:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.368722:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120808.368731:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789120808.368734:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946883582800 from 6 10000000:01000000:2.0:1789120808.368737:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789120808.368768:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.368777:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.368786:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120808.368842:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544512:0@lo:101: 00000100:00100000:2.0:1789120808.368881:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.368907:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bbbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.368922:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970544512 00000100:00100000:2.0:1789120808.368926:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970544512 00000100:00100000:2.0:1789120808.368953:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789120808.368959:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970544512:12345-0@lo:101: 00010000:00010000:2.0:1789120808.368978:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120808.368992:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a54200/0xb74d2367a830f277 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f270 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.369014:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a54200/0xb74d2367a830f277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f270 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.369038:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a54200/0xb74d2367a830f277 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f270 expref: 19 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.369046:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54200, rc 0) 00000100:00100000:2.0:1789120808.369079:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970544512:12345-0@lo:101: Request processed in 120us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.369085:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789120808.369117:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544512:0@lo:101: 00010000:00010000:2.0:1789120808.369129:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.369138:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120808.369180:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544640:0@lo:256: 00000100:00100000:2.0:1789120808.369211:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.369226:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bbbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.369240:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970544640 00000100:00100000:2.0:1789120808.369243:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970544640 00000100:00100000:2.0:1789120808.369265:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789120808.369272:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970544640:12345-0@lo:256: 20000000:01000000:2.0:1789120808.369458:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789120808.369560:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789120808.369564:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1789120808.369643:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970544640:12345-0@lo:256: Request processed in 371us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.369650:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789120808.369681:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544640:0@lo:256: 10000000:01000000:2.0:1789120808.369719:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789120808.369725:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.369733:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120808.369740:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789120808.369742:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:2.0:1789120808.369744:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789120808.369763:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.369770:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.369777:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120808.369790:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544768:0@lo:101: 00000100:00100000:2.0:1789120808.369818:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.369861:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bbbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.369880:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970544768 00000100:00100000:2.0:1789120808.369884:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970544768 00000100:00100000:2.0:1789120808.369908:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789120808.369915:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970544768:12345-0@lo:101: 00010000:00010000:2.0:1789120808.369923:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120808.369933:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55e00/0xb74d2367a830f285 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f27e expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.369950:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55e00/0xb74d2367a830f285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f27e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.369959:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55e00/0xb74d2367a830f285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f27e expref: 20 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.369966:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55e00, rc 0) 00000100:00100000:2.0:1789120808.369993:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970544768:12345-0@lo:101: Request processed in 79us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.369999:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789120808.370095:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544768:0@lo:101: 00010000:00010000:2.0:1789120808.370106:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.370115:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120808.370164:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544896:0@lo:501: 00000100:00100000:2.0:1789120808.370190:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.370203:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bbbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.370213:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970544896 00000100:00100000:2.0:1789120808.370223:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970544896 00000100:00100000:2.0:1789120808.370245:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789120808.370252:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970544896:12345-0@lo:501: 00000100:00100000:2.0:1789120808.370705:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970544896:12345-0@lo:501: Request processed in 452us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.370713:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789120808.370745:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970544896:0@lo:501: 00000100:00100000:2.0:1789120808.370775:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970545024:0@lo:503: 00000100:00100000:2.0:1789120808.370844:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.370860:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9bbbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.370873:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970545024 00000100:00100000:2.0:1789120808.370877:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970545024 00000100:00100000:2.0:1789120808.370899:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789120808.370905:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970545024:12345-0@lo:503: 00000100:00100000:2.0:1789120808.370988:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970545024:12345-0@lo:503: Request processed in 81us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.370995:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789120808.371399:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970545024:0@lo:503: 00000100:00100000:2.0:1789120808.371932:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9813:1876028970545152:0@lo:502: 00000100:00100000:2.0:1789120808.371983:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.372013:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970545152 00000100:00100000:2.0:1789120808.372030:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970545152 00000100:00100000:2.0:1789120808.372061:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789120808.372068:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+20:9813:x1876028970545152:12345-0@lo:502: 00000100:00100000:2.0:1789120808.372161:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+20:9813:x1876028970545152:12345-0@lo:502: Request processed in 93us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.372177:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789120808.372220:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff946888729900 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.372233:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9813:1876028970545152:0@lo:502: 00000020:01000000:2.0:1789120808.372257:0:9813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789120808.372264:0:9813:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1789120808.372271:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120808.372273:0:9813:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789120808.372278:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789120808.372282:0:9813:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:2.0:1789120808.372318:0:9813:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1789120808.372321:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789120808.372347:0:9813:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff946783c7ced8) 00000020:00000080:2.0:1789120808.372375:0:9813:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:2.0:1789120808.372382:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789120808.372493:0:9813:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1789120808.372500:0:9813:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789120808.372507:0:9813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a830f293 00010000:00080000:2.0:1789120808.372547:0:9813:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468afe5c800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789120808.372853:0:9813:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:2.0:1789120808.372989:0:9813:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1789120808.373001:0:9813:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1789120808.373175:0:9813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120808.373287:0:9813:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120808.373422:0:9813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1789120808.373552:0:9813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1789120808.374379:0:9814:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120808.374385:0:9814:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789120808.375626:0:9813:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789120808.375644:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789120808.375698:0:9813:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789120808.375727:0:9813:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a830f29a 00000100:00080000:2.0:1789120808.375746:0:9813:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789120808.375754:0:9813:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9468afe5c800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789120808.375791:0:9813:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b9c3ad00 x1876028970545280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789120808.375839:0:9813:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789120808.375899:0:9813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120808.375903:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120808.375905:0:9813:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789120808.375908:0:9813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120808.375912:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120808.375913:0:9813:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789120808.375916:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789120808.375918:0:9813:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789120808.375948:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9813:1876028970545408:0@lo:502: 00000100:00100000:2.0:1789120808.376169:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.376212:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e13a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.376236:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970545408 00000100:00100000:2.0:1789120808.376242:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970545408 00000100:00100000:2.0:1789120808.376280:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789120808.376378:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:9813:x1876028970545408:12345-0@lo:502: 00000100:00100000:2.0:1789120808.376614:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:9813:x1876028970545408:12345-0@lo:502: Request processed in 325us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.376624:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789120808.376690:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9813:1876028970545408:0@lo:502: 00000020:01000000:2.0:1789120808.376718:0:9813:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120808.376724:0:9813:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120808.376726:0:9813:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789120808.376730:0:9813:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:2.0:1789120808.376875:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:2.0:1789120808.376909:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789120808.376919:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.376932:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120808.376944:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789120808.376947:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946886899000 from 39 10000000:01000000:2.0:1789120808.376949:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789120808.376977:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.376985:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.376995:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120808.377010:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970545536:0@lo:101: 00000100:00100000:2.0:1789120808.377139:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.377157:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e13a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.377172:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970545536 00000100:00100000:2.0:1789120808.377177:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970545536 00000100:00100000:2.0:1789120808.377205:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789120808.377211:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970545536:12345-0@lo:101: 00010000:00010000:2.0:1789120808.377222:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120808.377234:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a54a00/0xb74d2367a830f2a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f2a1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.377269:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a54a00/0xb74d2367a830f2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f2a1 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.377280:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a54a00/0xb74d2367a830f2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f2a1 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.377565:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54a00, rc 0) 00000100:00100000:2.0:1789120808.377603:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970545536:12345-0@lo:101: Request processed in 390us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.377609:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789120808.377641:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970545536:0@lo:101: 00010000:00010000:2.0:1789120808.377653:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120808.377663:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120808.377717:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970545664:0@lo:501: 00000100:00100000:2.0:1789120808.377742:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.377764:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e13a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.377775:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970545664 00000100:00100000:2.0:1789120808.377779:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970545664 00000100:00100000:2.0:1789120808.377800:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789120808.377807:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970545664:12345-0@lo:501: 00000100:00100000:2.0:1789120808.377946:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970545664:12345-0@lo:501: Request processed in 138us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.377955:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789120808.377997:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970545664:0@lo:501: 00000100:00100000:2.0:1789120808.378110:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970545792:0@lo:503: 00000100:00100000:2.0:1789120808.378150:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.378162:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e13a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.378173:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970545792 00000100:00100000:2.0:1789120808.378176:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970545792 00000100:00100000:2.0:1789120808.378196:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789120808.378202:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970545792:12345-0@lo:503: 00000100:00100000:2.0:1789120808.378277:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970545792:12345-0@lo:503: Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.378284:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789120808.378420:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970545280:0@lo:8: 00000100:00100000:0.0:1789120808.378461:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120808.378525:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970545280 00000100:00100000:0.0:1789120808.378530:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970545280 00000100:00100000:0.0:1789120808.378553:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789120808.378558:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970545280:12345-0@lo:8: 00010000:00080000:0.0:1789120808.378586:0:8434:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:0.0:1789120808.378615:0:8434:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a830f2af 00002000:00100000:0.0:1789120808.378628:0:8434:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff946783266000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1789120808.378633:0:8434:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:0.0:1789120808.378637:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1789120808.378697:0:8434:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789120808.378950:0:8434:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1789120808.378978:0:8434:0:(import.c:65:import_set_state_nolock()) ffff946783260800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789120808.379043:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1876028970545280:12345-0@lo:8: Request processed in 483us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120808.379052:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1789120808.379091:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b9c3ad00 x1876028970545280/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789120818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120808.379102:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789120808.379110:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:0.0:1789120808.379125:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789120808.379132:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789120808.379135:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468afe5c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789120808.379148:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789120808.379153:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970545280:0@lo:8: 00000004:00080000:0.0:1789120808.379176:0:9814:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789120808.379234:0:9814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 258568413120ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789120808.379241:0:9814:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1789120808.379973:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970545792:0@lo:503: 00000100:00100000:0.0:1789120808.380932:0:9815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1876028970545920:0@lo:700: 00000100:00100000:0.0:1789120808.380993:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120808.381100:0:9815:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.381550:0:8442:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970545920 00000100:00100000:2.0:1789120808.381557:0:8442:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970545920 00000100:00100000:2.0:1789120808.381622:0:8442:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789120808.381632:0:8442:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9815:x1876028970545920:12345-0@lo:700: 00000100:00100000:2.0:1789120808.381672:0:8442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8442:1876028970546048:0@lo:700: 00000100:00100000:2.0:1789120808.381711:0:8442:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.381732:0:8442:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e13a240 going to sleep for 11 seconds 00000100:00080000:2.0:1789120808.381745:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120808.381764:0:6525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970546048 00000100:00100000:2.0:1789120808.381768:0:6525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970546048 00000100:00100000:2.0:1789120808.381797:0:6525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789120808.381805:0:6525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8442:x1876028970546048:12345-0@lo:700: 00000100:00100000:1.0:1789120808.382967:0:9816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9816:1876028970546176:0@lo:502: 00000100:00100000:1.0:1789120808.383117:0:9816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120808.383150:0:9816:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120808.384268:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970546176 00000100:00100000:2.0:1789120808.384279:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970546176 00000004:00080000:0.0:1789120808.384639:0:7450:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:2.0:1789120808.384870:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1789120808.384880:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:9816:x1876028970546176:12345-0@lo:502: 00000100:00100000:2.0:1789120808.386716:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:9816:x1876028970546176:12345-0@lo:502: Request processed in 1828us (3589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120808.386730:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789120808.389004:0:9816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9816:1876028970546176:0@lo:502: 00000100:00100000:1.0:1789120808.389112:0:9816:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9816:1876028970546304:0@lo:502: 00000100:00100000:1.0:1789120808.389185:0:9816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120808.389229:0:9816:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.389423:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970546304 00000100:00100000:3.0:1789120808.389431:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970546304 00000100:00100000:3.0:1789120808.389494:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789120808.389503:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:9816:x1876028970546304:12345-0@lo:502: 00000100:00100000:3.0:1789120808.389659:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:9816:x1876028970546304:12345-0@lo:502: Request processed in 157us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.389674:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789120808.390158:0:9816:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9816:1876028970546304:0@lo:502: 00000040:00080000:1.0:1789120808.390188:0:9816:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:3.0:1789120808.390653:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:3.0:1789120808.390689:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789120808.390699:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.390712:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120808.390723:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789120808.390726:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946886899000 from 6 10000000:01000000:3.0:1789120808.390729:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789120808.390760:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.390779:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.390791:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120808.390808:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970546432:0@lo:101: 00000100:00100000:3.0:1789120808.390885:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.390918:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.390934:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970546432 00000100:00100000:3.0:1789120808.390938:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970546432 00000100:00100000:3.0:1789120808.390975:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789120808.390982:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970546432:12345-0@lo:101: 00010000:00010000:3.0:1789120808.390994:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120808.391009:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887082000/0xb74d2367a830f2bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f2b6 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.391045:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887082000/0xb74d2367a830f2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f2b6 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.391056:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887082000/0xb74d2367a830f2bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f2b6 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.391065:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082000, rc 0) 00000100:00100000:3.0:1789120808.391101:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970546432:12345-0@lo:101: Request processed in 119us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.391108:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789120808.391148:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970546432:0@lo:101: 00010000:00010000:3.0:1789120808.391170:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.391179:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120808.391221:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970546560:0@lo:256: 00000100:00100000:3.0:1789120808.391249:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.391262:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.391277:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970546560 00000100:00100000:3.0:1789120808.391281:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970546560 00000100:00100000:3.0:1789120808.391450:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789120808.391457:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970546560:12345-0@lo:256: 20000000:01000000:3.0:1789120808.391553:0:6513:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789120808.391572:0:6513:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789120808.391575:0:6513:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1789120808.391651:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970546560:12345-0@lo:256: Request processed in 194us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.391659:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789120808.391692:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970546560:0@lo:256: 10000000:01000000:3.0:1789120808.391732:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789120808.391738:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.391747:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120808.391755:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789120808.391762:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789120808.391765:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789120808.391783:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.391791:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.391799:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120808.391812:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970546688:0@lo:101: 00000100:00100000:3.0:1789120808.391862:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.391882:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.391894:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970546688 00000100:00100000:3.0:1789120808.391897:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970546688 00000100:00100000:3.0:1789120808.391918:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789120808.391924:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970546688:12345-0@lo:101: 00010000:00010000:3.0:1789120808.391932:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120808.391942:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887083200/0xb74d2367a830f2cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f2c4 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.391958:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887083200/0xb74d2367a830f2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f2c4 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.391968:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887083200/0xb74d2367a830f2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f2c4 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.391977:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887083200, rc 0) 00000100:00100000:3.0:1789120808.392005:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970546688:12345-0@lo:101: Request processed in 81us (143us total) trans 0 rc 0/0 40000000:02000000:1.0:1789120808.392219:0:6525:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:3.0:1789120808.396502:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789120808.396648:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970546688:0@lo:101: 00010000:00010000:3.0:1789120808.396676:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.396689:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120808.396780:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970546816:0@lo:501: 00000100:00100000:3.0:1789120808.396856:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.396891:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.396908:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970546816 00000100:00100000:3.0:1789120808.396913:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970546816 00000100:00100000:3.0:1789120808.396948:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789120808.396957:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970546816:12345-0@lo:501: 00000100:00100000:3.0:1789120808.397237:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970546816:12345-0@lo:501: Request processed in 280us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.397245:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789120808.397279:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970546816:0@lo:501: 00000100:00100000:3.0:1789120808.397551:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970546944:0@lo:503: 00000100:00100000:3.0:1789120808.397602:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.397617:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.397631:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970546944 00000100:00100000:3.0:1789120808.397635:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970546944 00000100:00100000:3.0:1789120808.397718:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789120808.397728:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970546944:12345-0@lo:503: 00000100:00100000:3.0:1789120808.397848:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970546944:12345-0@lo:503: Request processed in 94us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.397855:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789120808.397898:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970546944:0@lo:503: 00000100:00100000:0.0:1789120808.398371:0:9817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9817:1876028970547072:0@lo:502: 00000100:00100000:0.0:1789120808.398417:0:9817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120808.398451:0:9817:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.398636:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970547072 00000100:00100000:3.0:1789120808.398641:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970547072 00000100:00100000:3.0:1789120808.398747:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789120808.398756:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:9817:x1876028970547072:12345-0@lo:502: 00000100:00100000:3.0:1789120808.398869:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:9817:x1876028970547072:12345-0@lo:502: Request processed in 114us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.398878:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789120808.398974:0:9817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9817:1876028970547072:0@lo:502: 00000020:01000000:0.0:1789120808.399000:0:9817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789120808.399007:0:9817:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789120808.399014:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120808.399028:0:9817:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789120808.399035:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789120808.399039:0:9817:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:0.0:1789120808.399061:0:9817:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789120808.399064:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789120808.399091:0:9817:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff946783ca0000) 00000020:00000080:0.0:1789120808.399116:0:9817:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:0.0:1789120808.399123:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789120808.399226:0:9817:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1789120808.399237:0:9817:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:0.0:1789120808.399245:0:9817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a830f2d9 00010000:00080000:0.0:1789120808.399278:0:9817:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946783ca8000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789120808.399899:0:9817:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:0.0:1789120808.400212:0:9817:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1789120808.400232:0:9817:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789120808.400874:0:9817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789120808.401000:0:9817:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789120808.401378:0:9817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1789120808.401573:0:9817:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1789120808.402112:0:9818:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120808.402118:0:9818:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789120808.404910:0:9817:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789120808.404924:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789120808.404976:0:9817:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789120808.405004:0:9817:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a830f2e0 00000100:00080000:0.0:1789120808.405374:0:9817:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789120808.405384:0:9817:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff946783ca8000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789120808.405425:0:9817:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783b26940 x1876028970547200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789120808.405458:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970547200:0@lo:8: 00000100:00100000:0.0:1789120808.405608:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120808.405739:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970547200 00000100:00100000:0.0:1789120808.405747:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970547200 00000100:00100000:0.0:1789120808.405793:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789120808.405801:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970547200:12345-0@lo:8: 00010000:00080000:0.0:1789120808.405855:0:8433:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:0.0:1789120808.405902:0:8433:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a830f2e7 00002000:00100000:0.0:1789120808.405917:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff946783cab800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1789120808.405926:0:8433:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1789120808.405929:0:8433:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1789120808.406006:0:8433:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1789120808.406157:0:6525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8442:x1876028970546048:12345-0@lo:700: Request processed in 24351us (24443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.406169:0:6525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789120808.406218:0:8442:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b9c3a1c0 x1876028970546048/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789120824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120808.406233:0:8442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8442:1876028970546048:0@lo:700: 40000000:02000000:1.0:1789120808.406245:0:8442:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00080000:0.0:1789120808.406562:0:8433:0:(import.c:65:import_set_state_nolock()) ffff946783cab000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789120808.406617:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876028970547200:12345-0@lo:8: Request processed in 815us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120808.406626:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789120808.406658:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b26940 x1876028970547200/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789120818 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120808.407166:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789120808.407174:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789120808.407184:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789120808.407189:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1789120808.407193:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783ca8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789120808.407259:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789120808.407266:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970547200:0@lo:8: 00000100:00080000:0.0:1789120808.407301:0:9817:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789120808.418885:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970547328:0@lo:13: 00000100:00100000:3.0:1789120808.418969:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120808.420253:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970547328 00000100:00100000:1.0:1789120808.420265:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970547328 00000100:00100000:1.0:1789120808.420350:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789120808.420361:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970547328:12345-0@lo:13: 00002000:00000024:1.0:1789120808.420394:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000020:01000000:0.0:1789120808.420763:0:9817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120808.420770:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120808.420773:0:9817:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789120808.420776:0:9817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120808.420780:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120808.420782:0:9817:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789120808.420785:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789120808.420787:0:9817:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789120808.420845:0:9817:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9817:1876028970547456:0@lo:502: 00000100:00100000:0.0:1789120808.420905:0:9817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789120808.420954:0:9819:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789120808.420979:0:9819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9819:1876028970547584:0@lo:7: 00000100:00100000:2.0:1789120808.421028:0:9819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120808.421062:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970547584 00000100:00100000:2.0:1789120808.421067:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970547584 00000100:00100000:2.0:1789120808.421101:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789120808.421108:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:9819:x1876028970547584:12345-0@lo:7: 00000100:00100000:1.0:1789120808.422045:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876028970547328:12345-0@lo:13: Request processed in 106us (1496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.422059:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789120808.422116:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789120808.422265:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bcfc00 x1876028970547328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120808.422297:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970547328:0@lo:13: 00000100:00100000:0.0:1789120808.423832:0:9817:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1cc00 going to sleep for 11 seconds 00000004:00080000:0.0:1789120808.423866:0:9818:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789120808.423935:0:9818:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 258613113688ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789120808.423942:0:9818:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1789120808.431126:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970547456 00000100:00100000:3.0:1789120808.431141:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970547456 00000100:00100000:3.0:1789120808.431201:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789120808.431212:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:9817:x1876028970547456:12345-0@lo:502: 00000100:00100000:3.0:1789120808.432096:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:9817:x1876028970547456:12345-0@lo:502: Request processed in 883us (11188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.432108:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789120808.432402:0:9819:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e13a240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120808.438798:0:9817:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:9817:1876028970547456:0@lo:502: 00000020:01000000:1.0:1789120808.438865:0:9817:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120808.438874:0:9817:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120808.438877:0:9817:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789120808.438883:0:9817:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1789120808.440777:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1789120808.440814:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789120808.440840:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.440854:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120808.440874:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789120808.440877:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9468ab900000 from 1 10000000:01000000:3.0:1789120808.440879:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789120808.440916:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.440924:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.440934:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120808.440954:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970547712:0@lo:101: 00000100:00100000:3.0:1789120808.441023:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.441072:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120808.441537:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970547712 00000100:00100000:1.0:1789120808.441546:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970547712 00000100:00100000:1.0:1789120808.441600:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789120808.441609:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970547712:12345-0@lo:101: 00010000:00010000:1.0:1789120808.441624:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120808.441637:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468a2f11a00/0xb74d2367a830f2f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f2ee expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120808.441672:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468a2f11a00/0xb74d2367a830f2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f2ee expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120808.441683:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468a2f11a00/0xb74d2367a830f2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f2ee expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120808.441692:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f11a00, rc 0) 00000100:00100000:1.0:1789120808.441741:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970547712:12345-0@lo:101: Request processed in 133us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.441750:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789120808.442264:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970547712:0@lo:101: 00010000:00010000:3.0:1789120808.442282:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.442304:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120808.442374:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970547840:0@lo:501: 00000100:00100000:3.0:1789120808.442409:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.442442:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120808.443629:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970547840 00000100:00100000:1.0:1789120808.443640:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970547840 00000100:00100000:1.0:1789120808.443704:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789120808.443714:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970547840:12345-0@lo:501: 00000100:00100000:1.0:1789120808.443859:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970547840:12345-0@lo:501: Request processed in 145us (1449us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789120808.443874:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789120808.444091:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970547840:0@lo:501: 10000000:01000000:3.0:1789120808.444132:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789120808.444148:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120808.444161:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1789120808.453328:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789120808.453342:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000004:00080000:0.0:1789120808.453368:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789120808.461158:0:8434:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1789120808.461170:0:8434:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789120808.461277:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:9819:x1876028970547584:12345-0@lo:7: Request processed in 40164us (40255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.461290:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789120808.461732:0:8442:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9815:x1876028970545920:12345-0@lo:700: Request processed in 80099us (80737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.461743:0:8442:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789120808.461842:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b270c0 x1876028970545920/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789120824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120808.461858:0:9815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1876028970545920:0@lo:700: 00010000:00080000:0.0:1789120808.463551:0:9819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b9c3a1c0 x1876028970547584/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789120824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120808.463570:0:9819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9819:1876028970547584:0@lo:7: 00000004:00080000:0.0:1789120808.463585:0:9819:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789120808.463637:0:9819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9819:1876028970547968:0@lo:5: 00000100:00100000:0.0:1789120808.464048:0:9819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120808.464096:0:9819:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120808.464156:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970547968 00000100:00100000:1.0:1789120808.464163:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970547968 00000100:00100000:1.0:1789120808.464223:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789120808.464235:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9819:x1876028970547968:12345-0@lo:5: 00002000:00080000:1.0:1789120808.464264:0:8433:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789120808.464268:0:8433:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789120808.464943:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9819:x1876028970547968:12345-0@lo:5: Request processed in 708us (894us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789120808.464951:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1789120808.465092:0:9819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b252c0 x1876028970547968/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120808.465108:0:9819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9819:1876028970547968:0@lo:5: 00000004:00080000:3.0:1789120808.465119:0:9819:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789120808.465153:0:9819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9819:1876028970548096:0@lo:700: 00000100:00100000:3.0:1789120808.465188:0:9819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.465221:0:9819:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120808.465394:0:8441:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970548096 00000100:00100000:1.0:1789120808.465401:0:8441:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970548096 00000100:00100000:1.0:1789120808.465620:0:8441:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789120808.465630:0:8441:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:9819:x1876028970548096:12345-0@lo:700: 00000004:00080000:0.0:1789120808.471598:0:9815:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789120808.471634:0:9815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1876028970548352:0@lo:7: 00000100:00100000:1.0:1789120808.471892:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120808.471906:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970548224:0@lo:13: 00000100:00100000:1.0:1789120808.471969:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120808.472028:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970548224 00000100:00100000:1.0:1789120808.472035:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970548224 00000100:00100000:1.0:1789120808.472081:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789120808.472091:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970548224:12345-0@lo:13: 00002000:00000024:1.0:1789120808.472123:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:1.0:1789120808.472170:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f9a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970548224:12345-0@lo:13: Request processed in 81us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.472178:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789120808.472224:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b261c0 x1876028970548224/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120808.472242:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970548224:0@lo:13: 00000100:00100000:0.0:1789120808.472607:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120808.472637:0:9815:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120808.472861:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970548352 00000100:00100000:1.0:1789120808.472866:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970548352 00000100:00100000:1.0:1789120808.472900:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789120808.472907:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9815:x1876028970548352:12345-0@lo:7: 00000001:00080000:0.0:1789120808.477019:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:0.0:1789120808.479559:0:8441:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bccb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9819:x1876028970548096:12345-0@lo:700: Request processed in 13922us (14362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120808.479576:0:8441:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789120808.480965:0:9819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bcc3c0 x1876028970548096/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789120824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120808.480980:0:9819:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789120808.481000:0:9819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9819:1876028970548096:0@lo:700: 00002000:00080000:1.0:1789120808.493479:0:9116:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1789120808.493490:0:9116:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1789120808.502722:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9815:x1876028970548352:12345-0@lo:7: Request processed in 29804us (30104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120808.502739:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789120808.503589:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b270c0 x1876028970548352/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789120824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120808.503608:0:9815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1876028970548352:0@lo:7: 00000004:00080000:0.0:1789120808.503624:0:9815:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789120808.503702:0:9815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1876028970548480:0@lo:5: 00000100:00100000:0.0:1789120808.503760:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120808.503809:0:9815:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1cc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120808.503868:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970548480 00000100:00100000:0.0:1789120808.503875:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970548480 00000100:00100000:0.0:1789120808.503921:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789120808.503930:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9815:x1876028970548480:12345-0@lo:5: 00002000:00080000:0.0:1789120808.503958:0:8435:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:0.0:1789120808.504001:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9815:x1876028970548480:12345-0@lo:5: Request processed in 72us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120808.504009:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789120808.504037:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b270c0 x1876028970548480/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120824 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120808.504046:0:9815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1876028970548480:0@lo:5: 00000004:00080000:0.0:1789120808.504054:0:9815:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789120808.504076:0:9815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1876028970548608:0@lo:5: 00000100:00100000:0.0:1789120808.504098:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120808.504114:0:9815:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1cc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.504306:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970548608 00000100:00100000:3.0:1789120808.504311:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970548608 00000100:00100000:3.0:1789120808.504349:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789120808.504357:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:9815:x1876028970548608:12345-0@lo:5: 00002000:00080000:3.0:1789120808.504391:0:8434:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:3.0:1789120808.506271:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:9815:x1876028970548608:12345-0@lo:5: Request processed in 1909us (2165us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789120808.506284:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789120808.506396:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b270c0 x1876028970548608/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120808.506414:0:9815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b270c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9815:1876028970548608:0@lo:5: 00000004:00080000:3.0:1789120808.506428:0:9815:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789120808.506468:0:9815:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9815:1876028970548736:0@lo:900: 00000100:00100000:3.0:1789120808.506506:0:9815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.506544:0:9815:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b293c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120808.506563:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970548736 00000100:00100000:3.0:1789120808.506569:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970548736 00000100:00100000:3.0:1789120808.506606:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789120808.506614:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9815:x1876028970548736:12345-0@lo:900: 00000100:00100000:3.0:1789120808.506660:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9815:x1876028970548736:12345-0@lo:900: Request processed in 47us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120808.506667:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789120808.506695:0:9815:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bcc3c0 x1876028970548736/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789120824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120808.506704:0:9815:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9815:1876028970548736:0@lo:900: 00000004:02000040:3.0:1789120808.512256:0:9819:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00000100:00100000:3.0:1789120808.550607:0:9819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9819:1876028970548864:0@lo:5: 00000100:00100000:3.0:1789120808.550680:0:9819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120808.550724:0:9819:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b293c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120808.552184:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970548864 00000100:00100000:0.0:1789120808.552195:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970548864 00000100:00100000:0.0:1789120808.552278:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120808.552291:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9819:x1876028970548864:12345-0@lo:5: 00010000:00010000:2.0:1789120808.598304:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789120808.602009:0:8435:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789120808.602174:0:8435:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:0.0:1789120808.614750:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcf840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9819:x1876028970548864:12345-0@lo:5: Request processed in 62453us (64061us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789120808.614765:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789120808.615692:0:9819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bcc3c0 x1876028970548864/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789120824 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120808.615713:0:9819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9819:1876028970548864:0@lo:5: 00000004:00080000:3.0:1789120808.615729:0:9819:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00010000:00010000:3.0:1789120809.618051:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120810.642093:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789120810.780235:0:9888:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789120811.411128:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120811.411153:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970548992:0@lo:41: 00000100:00100000:3.0:1789120811.411235:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120811.411299:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120811.411309:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970549120:0@lo:41: 00000100:00100000:3.0:1789120811.411337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120811.411915:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970548992 00000100:00100000:0.0:1789120811.411924:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970548992 00000100:00100000:0.0:1789120811.411963:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970549120 00000100:00100000:0.0:1789120811.411967:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970549120 00000100:00100000:0.0:1789120811.411984:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789120811.411992:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970548992:12345-0@lo:41: 00000004:00000024:0.0:1789120811.412028:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789120811.416850:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970548992:12345-0@lo:41: Request processed in 4848us (5605us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120811.416867:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789120811.416909:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789120811.416924:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970549120:12345-0@lo:41: 00000004:00000024:0.0:1789120811.416965:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789120811.417052:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970549120:12345-0@lo:41: Request processed in 135us (5714us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120811.417059:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789120811.417425:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970549120:0@lo:41: 00000100:00100000:3.0:1789120811.426434:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fa580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970548992:0@lo:41: 00010000:00010000:3.0:1789120811.667045:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789120812.182157:0:9940:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789120812.184643:0:9940:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789120812.690196:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789120813.349767:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:3.0:1789120813.349795:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1789120813.459199:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789120813.459240:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970549760:0@lo:400: 00000100:00100000:2.0:1789120813.459341:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120813.459420:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970549248:0@lo:400: 00000100:00100000:2.0:1789120813.459454:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120813.459490:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970549376:0@lo:13: 00000100:00100000:2.0:1789120813.459518:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120813.459540:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970550272:0@lo:400: 00000100:00100000:2.0:1789120813.459564:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120813.459580:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970550784:0@lo:400: 00000100:00100000:2.0:1789120813.459620:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120813.459637:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789120813.459653:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970549888:0@lo:400: 00000100:00100000:2.0:1789120813.459680:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120813.459697:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970550400:0@lo:400: 00000100:00100000:2.0:1789120813.459717:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120813.459732:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970550912:0@lo:400: 00000100:00100000:2.0:1789120813.459751:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120813.459779:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970549248 00000100:00100000:2.0:1789120813.459786:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970549248 00000100:00100000:2.0:1789120813.459862:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789120813.459873:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970549248:12345-0@lo:400: 00000100:00100000:2.0:1789120813.459928:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970549248:12345-0@lo:400: Request processed in 57us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120813.459936:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1789120813.459987:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970549248:0@lo:400: 00000100:00100000:1.0:1789120813.460200:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970549376 00000100:00100000:1.0:1789120813.460204:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970549376 00000100:00100000:1.0:1789120813.460246:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789120813.460254:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970549376:12345-0@lo:13: 00002000:00000024:1.0:1789120813.460283:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120813.460295:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970549504:0@lo:400: 00000100:00100000:1.0:1789120813.460324:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970549376:12345-0@lo:13: Request processed in 72us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120813.460331:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789120813.460339:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120813.460360:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970550272 00000100:00100000:3.0:1789120813.460362:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970550016:0@lo:400: 00000100:00100000:1.0:1789120813.460363:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970550272 00000100:00100000:1.0:1789120813.460381:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970550784 00000100:00100000:3.0:1789120813.460384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120813.460384:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970550784 00000100:00100000:1.0:1789120813.460397:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970550400 00000100:00100000:3.0:1789120813.460400:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970550528:0@lo:400: 00000100:00100000:1.0:1789120813.460400:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970550400 00000100:00100000:1.0:1789120813.460411:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970550912 00000100:00100000:1.0:1789120813.460413:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970550912 00000100:00100000:3.0:1789120813.460421:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120813.460426:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789120813.460432:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970550272:12345-0@lo:400: 00000100:00100000:3.0:1789120813.460440:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970551040:0@lo:13: 00000100:00100000:3.0:1789120813.460458:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120813.460461:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970550272:12345-0@lo:400: Request processed in 30us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120813.460479:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789120813.460485:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789120813.460490:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789120813.460491:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970549632:0@lo:400: 00000100:00100000:1.0:1789120813.460496:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970550784:12345-0@lo:400: 00000100:00100000:3.0:1789120813.460519:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120813.460521:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970550784:12345-0@lo:400: Request processed in 26us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120813.460527:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789120813.460536:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970550144:0@lo:400: 00000100:00100000:1.0:1789120813.460538:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789120813.460544:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970550400:12345-0@lo:400: 00000100:00100000:3.0:1789120813.460557:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120813.460566:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970550400:12345-0@lo:400: Request processed in 24us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120813.460567:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970550656:0@lo:400: 00000100:00100000:1.0:1789120813.460572:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789120813.460587:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120813.460592:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789120813.460599:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970550912:12345-0@lo:400: 00000100:00100000:3.0:1789120813.460618:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970549760 00000100:00100000:3.0:1789120813.460622:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970549760 00000100:00100000:1.0:1789120813.460624:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970550912:12345-0@lo:400: Request processed in 26us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120813.460629:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789120813.460644:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970549504 00000100:00100000:3.0:1789120813.460647:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970549504 00000100:00100000:3.0:1789120813.460658:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970550016 00000100:00080000:1.0:1789120813.460658:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120813.460660:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970550016 00000100:00080000:1.0:1789120813.460662:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120813.460672:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970551040 00000100:00100000:1.0:1789120813.460675:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970551040 00000100:00100000:3.0:1789120813.460679:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970550528 00000100:00100000:3.0:1789120813.460681:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970550528 00000100:00100000:1.0:1789120813.460688:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789120813.460691:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970550144 00000100:00100000:3.0:1789120813.460693:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970550144 00000100:00100000:1.0:1789120813.460693:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970551040:12345-0@lo:13: 00002000:00000024:1.0:1789120813.460702:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120813.460705:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970550656 00000100:00100000:3.0:1789120813.460707:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970550656 00000100:00100000:3.0:1789120813.460719:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789120813.460725:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970549760:12345-0@lo:400: 00000100:00100000:1.0:1789120813.460730:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970551040:12345-0@lo:13: Request processed in 37us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120813.460736:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789120813.460759:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970549760:12345-0@lo:400: Request processed in 34us (1418us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120813.460765:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789120813.460765:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99b0000 x1876028970550400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120813.460777:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970550400:0@lo:400: 00000100:00100000:3.0:1789120813.460778:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789120813.460784:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970549504:12345-0@lo:400: 00010000:00080000:1.0:1789120813.460787:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b05a40 x1876028970550912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120813.460796:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:3.0:1789120813.460806:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970549504:12345-0@lo:400: Request processed in 23us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120813.460807:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970550912:0@lo:400: 00000100:00100000:3.0:1789120813.460812:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789120813.460817:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99b0f00 x1876028970550272/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120813.460851:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970550272:0@lo:400: 00010000:00080000:1.0:1789120813.460864:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b07c00 x1876028970550784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120813.460871:0:3644:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789120813.460883:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970550784:0@lo:400: 00010000:00080000:1.0:1789120813.460895:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bcd680 x1876028970549760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120813.460912:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970549760:0@lo:400: 00010000:00080000:1.0:1789120813.460924:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b9c392c0 x1876028970549376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120813.460939:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970549376:0@lo:13: 00000100:00100000:0.0:1789120813.461116:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789120813.461127:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970550016:12345-0@lo:400: 00000100:00100000:0.0:1789120813.461166:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970550016:12345-0@lo:400: Request processed in 43us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120813.461172:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789120813.461186:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789120813.461192:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970550528:12345-0@lo:400: 00000100:00100000:3.0:1789120813.461211:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789120813.461218:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970550144:12345-0@lo:400: 00000100:00100000:0.0:1789120813.461219:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970550528:12345-0@lo:400: Request processed in 28us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120813.461225:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789120813.461242:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789120813.461247:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970550656:12345-0@lo:400: 00000100:00100000:3.0:1789120813.461252:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970550144:12345-0@lo:400: Request processed in 36us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120813.461258:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789120813.461271:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970550656:12345-0@lo:400: Request processed in 24us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120813.461277:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789120813.461288:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970549888 00000100:00100000:3.0:1789120813.461292:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970549888 00000100:00100000:0.0:1789120813.461294:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970549632 00000100:00100000:0.0:1789120813.461296:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970549632 00000100:00100000:3.0:1789120813.461311:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789120813.462222:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970551168:0@lo:13: 00000100:00100000:1.0:1789120813.462281:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120813.462436:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970551168 00000100:00100000:2.0:1789120813.462443:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970551168 00000100:00100000:2.0:1789120813.462488:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120813.462497:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970551168:12345-0@lo:13: 00002000:00000024:2.0:1789120813.462526:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120813.462588:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970551168:12345-0@lo:13: Request processed in 85us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120813.462595:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789120813.462720:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b9c3bc00 x1876028970551168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120813.462740:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970551168:0@lo:13: 00000100:00080000:1.0:1789120813.464609:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120813.464624:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120813.465127:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970549888:12345-0@lo:400: 00000100:00100000:3.0:1789120813.465271:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970549888:12345-0@lo:400: Request processed in 3953us (5589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120813.465373:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970549888:0@lo:400: 00000100:00100000:3.0:1789120813.466781:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789120813.466849:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789120813.466868:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970549632:12345-0@lo:400: 00000100:00100000:3.0:1789120813.466965:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970549632:12345-0@lo:400: Request processed in 108us (6445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120813.466973:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1789120813.467955:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99b0780 x1876028970550144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120813.467977:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970550144:0@lo:400: 00010000:00080000:0.0:1789120813.468245:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b06580 x1876028970550656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120813.468256:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970550656:0@lo:400: 00010000:00080000:0.0:1789120813.468276:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467831f8000 x1876028970551040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120813.468298:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970551040:0@lo:13: 00010000:00080000:0.0:1789120813.468313:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bcf0c0 x1876028970549504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120813.468332:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970549504:0@lo:400: 00010000:00080000:0.0:1789120813.468355:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bce1c0 x1876028970550016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120813.468364:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970550016:0@lo:400: 00010000:00080000:0.0:1789120813.468376:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b05680 x1876028970550528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120813.468414:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970550528:0@lo:400: 00000100:00100000:0.0:1789120813.468461:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970549632:0@lo:400: 00010000:00010000:3.0:1789120813.715372:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120813.970378:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120813.970423:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970551296:0@lo:13: 00000100:00100000:0.0:1789120813.970546:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120813.970737:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970551296 00000100:00100000:2.0:1789120813.970747:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970551296 00000100:00100000:2.0:1789120813.970805:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789120813.970815:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970551296:12345-0@lo:13: 00002000:00000024:2.0:1789120813.970874:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120813.970944:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970551296:12345-0@lo:13: Request processed in 130us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120813.970952:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789120813.971323:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b04f00 x1876028970551296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120813.971346:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970551296:0@lo:13: 00010000:00010000:3.0:1789120814.739368:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789120815.297975:0:10041:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789120815.298256:0:10041:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789120815.761985:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789120816.190066:0:10089:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789120816.190077:0:10089:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:0.0:1789120816.530683:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120816.530702:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970551424:0@lo:41: 00000100:00100000:1.0:1789120816.530703:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970551552:0@lo:41: 00000100:00100000:0.0:1789120816.531002:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120816.531112:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120816.531200:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970551424 00000100:00100000:0.0:1789120816.531207:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970551424 00000100:00100000:0.0:1789120816.531244:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970551552 00000100:00100000:0.0:1789120816.531246:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970551552 00000100:00100000:0.0:1789120816.531261:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789120816.531269:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970551424:12345-0@lo:41: 00000004:00000024:0.0:1789120816.531306:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789120816.531370:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970551424:12345-0@lo:41: Request processed in 101us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120816.531378:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789120816.531398:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789120816.531404:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970551552:12345-0@lo:41: 00000004:00000024:0.0:1789120816.531422:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789120816.531471:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970551552:12345-0@lo:41: Request processed in 67us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120816.531493:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789120816.531539:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970551552:0@lo:41: 00000100:00100000:2.0:1789120816.531603:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970551424:0@lo:41: 00010000:00010000:2.0:1789120816.787641:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120816.809264:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120816.811578:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947431552 00000100:00100000:1.0:1789120816.811611:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947431552 00000100:00100000:1.0:1789120816.811893:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 181 00000100:00100000:1.0:1789120816.811905:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2408:x1876028947431552:12345-192.168.202.32@tcp:250: 00010000:00080000:1.0:1789120816.811933:0:6512:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 75b5d71e-0e31-479d-b240-b6a98d05b974@192.168.202.32@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:1.0:1789120816.812014:0:6512:0:(genops.c:1385:class_connect()) connect: client 75b5d71e-0e31-479d-b240-b6a98d05b974, cookie 0xb74d2367a830f2fc 00000100:00080000:1.0:1789120816.812145:0:6512:0:(import.c:65:import_set_state_nolock()) ffff9467839fb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120816.812323:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+5:2408:x1876028947431552:12345-192.168.202.32@tcp:250: Request processed in 419us (3067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120816.812329:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 181 00000100:00100000:2.0:1789120816.819004:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120816.819190:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947431680 00000100:00100000:1.0:1789120816.819199:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947431680 00000100:00100000:1.0:1789120816.819262:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 182 00000100:00100000:1.0:1789120816.819271:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+5:6172:x1876028947431680:12345-192.168.202.32@tcp:101: 00010000:00010000:1.0:1789120816.819286:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120816.819300:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468a2f10400/0xb74d2367a830f303 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e873 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120816.819321:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468a2f10400/0xb74d2367a830f303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e873 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120816.819329:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468a2f10400/0xb74d2367a830f303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e873 expref: 6 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120816.819335:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f10400, rc 0) 00000100:00100000:1.0:1789120816.819390:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+6:6172:x1876028947431680:12345-192.168.202.32@tcp:101: Request processed in 121us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120816.819395:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 182 00000100:00100000:0.0:1789120816.829111:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120816.829213:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947431808 00000100:00100000:2.0:1789120816.829222:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947431808 00000100:00100000:2.0:1789120816.829283:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 183 00000100:00100000:2.0:1789120816.829292:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+6:6172:x1876028947431808:12345-192.168.202.32@tcp:501: 00000100:00100000:2.0:1789120816.829428:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+6:6172:x1876028947431808:12345-192.168.202.32@tcp:501: Request processed in 136us (326us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789120816.829445:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 183 00000100:00100000:3.0:1789120816.833810:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120816.834508:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947431936 00000100:00100000:2.0:1789120816.834519:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947431936 00000100:00100000:2.0:1789120816.834633:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 184 00000100:00100000:2.0:1789120816.834645:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+6:6172:x1876028947431936:12345-192.168.202.32@tcp:101: 00010000:00010000:2.0:1789120816.834663:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120816.834682:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55600/0xb74d2367a830f30a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e87a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120816.834712:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55600/0xb74d2367a830f30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e87a expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120816.834755:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55600/0xb74d2367a830f30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e87a expref: 7 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120816.834773:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55600, rc 0) 00000100:00100000:2.0:1789120816.834857:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+7:6172:x1876028947431936:12345-192.168.202.32@tcp:101: Request processed in 214us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120816.834865:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 184 00000100:00100000:0.0:1789120816.840260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120816.841353:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947432064 00000100:00100000:1.0:1789120816.841486:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947432064 00000100:00100000:1.0:1789120816.841761:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 185 00000100:00100000:1.0:1789120816.841772:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+7:6172:x1876028947432064:12345-192.168.202.32@tcp:501: 00000100:00100000:1.0:1789120816.841968:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+8:6172:x1876028947432064:12345-192.168.202.32@tcp:501: Request processed in 197us (1717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120816.841977:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 185 00000100:00100000:3.0:1789120816.847135:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120816.847392:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947432192 00000100:00100000:2.0:1789120816.847412:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947432192 00000100:00100000:2.0:1789120816.847485:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 186 00000100:00100000:2.0:1789120816.847496:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+8:6172:x1876028947432192:12345-192.168.202.32@tcp:503: 00000100:00100000:2.0:1789120816.847669:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+8:6172:x1876028947432192:12345-192.168.202.32@tcp:503: Request processed in 174us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120816.847678:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 186 00000100:00100000:2.0:1789120816.854078:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120816.854179:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947432320 00000100:00100000:1.0:1789120816.854188:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947432320 00000100:00100000:1.0:1789120816.854245:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 187 00000100:00100000:1.0:1789120816.854269:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+8:6190:x1876028947432320:12345-192.168.202.32@tcp:502: 00000100:00100000:1.0:1789120816.854542:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+8:6190:x1876028947432320:12345-192.168.202.32@tcp:502: Request processed in 273us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120816.854550:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 187 00000100:00100000:1.0:1789120816.896622:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120816.896692:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947432448 00000100:00100000:0.0:1789120816.896702:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947432448 00000100:00100000:0.0:1789120816.896763:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 188 00000100:00100000:0.0:1789120816.896774:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+8:6190:x1876028947432448:12345-192.168.202.32@tcp:502: 00000100:00100000:0.0:1789120816.896986:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+8:6190:x1876028947432448:12345-192.168.202.32@tcp:502: Request processed in 213us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120816.896997:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 188 00000100:00100000:2.0:1789120816.903237:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120816.903345:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947432576 00000100:00100000:1.0:1789120816.903355:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947432576 00000100:00100000:1.0:1789120816.903425:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 189 00000100:00100000:1.0:1789120816.903447:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+8:6172:x1876028947432576:12345-192.168.202.32@tcp:101: 00010000:00010000:1.0:1789120816.903466:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120816.903488:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468a2f11e00/0xb74d2367a830f311 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e8ab expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120816.903522:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468a2f11e00/0xb74d2367a830f311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8ab expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120816.903533:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468a2f11e00/0xb74d2367a830f311 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8ab expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120816.903542:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f11e00, rc 0) 00000100:00100000:1.0:1789120816.903700:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6172:x1876028947432576:12345-192.168.202.32@tcp:101: Request processed in 265us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120816.903708:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 189 00000100:00100000:1.0:1789120816.915571:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120816.915672:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947432704 00000100:00100000:2.0:1789120816.915681:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947432704 00000100:00100000:2.0:1789120816.915741:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 190 00000100:00100000:2.0:1789120816.915751:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6172:x1876028947432704:12345-192.168.202.32@tcp:256: 20000000:01000000:2.0:1789120816.915776:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1789120816.915800:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789120816.915803:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1789120816.915807:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1789120816.915810:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:2.0:1789120816.915812:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:1.0:1789120816.920381:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6172:x1876028947432704:12345-192.168.202.32@tcp:256: Request processed in 4619us (4808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120816.920397:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 190 00000100:00100000:3.0:1789120816.923652:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120816.923800:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947432832 00000100:00100000:1.0:1789120816.923810:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947432832 00000100:00100000:1.0:1789120816.923909:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 191 00000100:00100000:1.0:1789120816.923921:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6172:x1876028947432832:12345-192.168.202.32@tcp:101: 00010000:00010000:1.0:1789120816.923938:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120816.923992:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a3a00/0xb74d2367a830f318 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e8b2 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120816.924023:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3a00/0xb74d2367a830f318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8b2 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120816.924035:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a3a00/0xb74d2367a830f318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8b2 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120816.924042:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3a00, rc 0) 00000100:00100000:1.0:1789120816.924094:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6172:x1876028947432832:12345-192.168.202.32@tcp:101: Request processed in 177us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120816.924099:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 191 00000100:00100000:1.0:1789120816.942114:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120816.942277:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947432960 00000100:00100000:2.0:1789120816.942287:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947432960 00000100:00100000:2.0:1789120816.942351:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 192 00000100:00100000:2.0:1789120816.942361:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6172:x1876028947432960:12345-192.168.202.32@tcp:501: 00000100:00100000:2.0:1789120816.942548:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6172:x1876028947432960:12345-192.168.202.32@tcp:501: Request processed in 187us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120816.942557:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 192 00000100:00100000:2.0:1789120816.949254:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120816.953720:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947433088 00000100:00100000:0.0:1789120816.953734:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947433088 00000100:00100000:0.0:1789120816.953834:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 193 00000100:00100000:0.0:1789120816.953846:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6172:x1876028947433088:12345-192.168.202.32@tcp:503: 00000100:00100000:0.0:1789120816.954021:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6172:x1876028947433088:12345-192.168.202.32@tcp:503: Request processed in 176us (4775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120816.954029:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 193 00000100:00100000:3.0:1789120816.963464:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120816.963498:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947433216 00000100:00100000:1.0:1789120816.963508:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947433216 00000100:00100000:1.0:1789120816.963572:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 194 00000100:00100000:1.0:1789120816.963592:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6193:x1876028947433216:12345-192.168.202.32@tcp:502: 00000100:00100000:1.0:1789120816.963755:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6193:x1876028947433216:12345-192.168.202.32@tcp:502: Request processed in 165us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120816.963763:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 194 00000100:00100000:1.0:1789120816.968041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120816.970341:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947433344 00000100:00100000:2.0:1789120816.970355:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947433344 00000100:00100000:2.0:1789120816.970427:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 195 00000100:00100000:2.0:1789120816.970445:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6193:x1876028947433344:12345-192.168.202.32@tcp:502: 00000100:00100000:2.0:1789120816.970684:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6193:x1876028947433344:12345-192.168.202.32@tcp:502: Request processed in 248us (2895us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120816.970693:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 195 00000100:00100000:2.0:1789120816.976915:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120816.977502:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947433472 00000100:00100000:3.0:1789120816.977519:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947433472 00000100:00100000:3.0:1789120816.977610:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789120816.977622:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1876028947433472:12345-192.168.202.32@tcp:38: 00010000:00080000:3.0:1789120816.977683:0:9342:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:3.0:1789120816.977754:0:9342:0:(genops.c:1385:class_connect()) connect: client 3dde8702-0a22-4cb8-87f3-66b167299fdd, cookie 0xb74d2367a830f31f 00000004:00100000:3.0:1789120816.977806:0:9342:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789120816.978524:0:9342:0:(import.c:65:import_set_state_nolock()) ffff946783061000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789120816.978677:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2408:x1876028947433472:12345-192.168.202.32@tcp:38: Request processed in 1054us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120816.978704:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789120816.985210:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120816.985383:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947433728 00000100:00100000:2.0:1789120816.985393:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947433728 00000100:00100000:2.0:1789120816.985447:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:2.0:1789120816.985456:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2408:x1876028947433728:12345-192.168.202.32@tcp:38: 00010000:00080000:2.0:1789120816.985493:0:6519:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp t0 exp 0000000000000000 cur 267 last 0 00000020:00000080:2.0:1789120816.985570:0:6519:0:(genops.c:1385:class_connect()) connect: client 3dde8702-0a22-4cb8-87f3-66b167299fdd, cookie 0xb74d2367a830f326 00000004:00100000:2.0:1789120816.985595:0:6519:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789120816.986196:0:6519:0:(import.c:65:import_set_state_nolock()) ffff9468bf6ae000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789120816.986312:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2408:x1876028947433728:12345-192.168.202.32@tcp:38: Request processed in 855us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120816.986330:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00010000:00010000:3.0:1789120817.810632:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120817.982911:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120817.982958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120817.983021:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947433856 00000100:00100000:3.0:1789120817.983035:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947433856 00000100:00100000:3.0:1789120817.983122:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947433600 00000100:00100000:3.0:1789120817.983126:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947433600 00000100:00100000:3.0:1789120817.983158:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:3.0:1789120817.983169:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:0:x1876028947433856:12345-192.168.202.32@tcp:41: 00000004:00000024:3.0:1789120817.983223:0:9342:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120817.983303:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:3.0:1789120817.983315:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:0:x1876028947433856:12345-192.168.202.32@tcp:41: Request processed in 147us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120817.983333:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:0:x1876028947433600:12345-192.168.202.32@tcp:41: 00000004:00000024:1.0:1789120817.983356:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1789120817.983386:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:0:x1876028947433600:12345-192.168.202.32@tcp:41: Request processed in 57us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120817.983393:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:3.0:1789120817.984135:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00080000:2.0:1789120817.984215:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120817.984220:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789120817.985673:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120817.985818:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947433984 00000100:00100000:2.0:1789120817.985853:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947433984 00000100:00100000:2.0:1789120817.985938:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:2.0:1789120817.985950:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6172:x1876028947433984:12345-192.168.202.32@tcp:41: 00000004:00000024:2.0:1789120817.985991:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789120817.986075:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6172:x1876028947433984:12345-192.168.202.32@tcp:41: Request processed in 127us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120817.986084:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:1.0:1789120817.989999:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120817.990108:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947434112 00000100:00100000:0.0:1789120817.990121:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947434112 00000100:00100000:0.0:1789120817.990195:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789120817.990207:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6172:x1876028947434112:12345-192.168.202.32@tcp:40: 00000100:00100000:0.0:1789120817.990340:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6172:x1876028947434112:12345-192.168.202.32@tcp:40: Request processed in 135us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120817.990349:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:1.0:1789120817.996361:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120817.996664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120817.996943:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947434240 00000100:00100000:3.0:1789120817.996954:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947434240 00000100:00100000:2.0:1789120817.997008:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947434368 00000100:00100000:2.0:1789120817.997013:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947434368 00000100:00100000:2.0:1789120817.997046:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:2.0:1789120817.997054:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2408:x1876028947434240:12345-192.168.202.32@tcp:8: 00010000:00080000:2.0:1789120817.997093:0:8433:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:2.0:1789120817.997127:0:8433:0:(genops.c:1385:class_connect()) connect: client 3dde8702-0a22-4cb8-87f3-66b167299fdd, cookie 0xb74d2367a830f32d 00002000:00100000:2.0:1789120817.997140:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3dde8702-0a22-4cb8-87f3-66b167299fdd/ffff9468bf6ab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789120817.997158:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789120817.997356:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:0.0:1789120817.997371:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2408:x1876028947434368:12345-192.168.202.32@tcp:8: 00010000:00080000:0.0:1789120817.997409:0:9116:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:0.0:1789120817.997452:0:9116:0:(genops.c:1385:class_connect()) connect: client 3dde8702-0a22-4cb8-87f3-66b167299fdd, cookie 0xb74d2367a830f334 00002000:00100000:0.0:1789120817.997463:0:9116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3dde8702-0a22-4cb8-87f3-66b167299fdd/ffff946783caf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789120817.997481:0:9116:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789120817.997680:0:9116:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789120817.997725:0:9116:0:(import.c:65:import_set_state_nolock()) ffff946783caf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789120817.997861:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2408:x1876028947434368:12345-192.168.202.32@tcp:8: Request processed in 454us (1158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120817.997870:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00002000:00080000:2.0:1789120817.997982:0:8433:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789120817.998105:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9468bf6ac800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789120817.998177:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2408:x1876028947434240:12345-192.168.202.32@tcp:8: Request processed in 1120us (1823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120817.998203:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:1.0:1789120818.001302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120818.001410:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947434496 00000100:00100000:3.0:1789120818.001419:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947434496 00000100:00100000:3.0:1789120818.001539:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:3.0:1789120818.001550:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6172:x1876028947434496:12345-192.168.202.32@tcp:900: 00000100:00100000:3.0:1789120818.001650:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6172:x1876028947434496:12345-192.168.202.32@tcp:900: Request processed in 98us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120818.001674:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:0.0:1789120818.003142:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120818.003250:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947434624 00000100:00100000:2.0:1789120818.003258:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947434624 00000100:00100000:2.0:1789120818.003364:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 196 00000100:00100000:2.0:1789120818.003375:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2412:x1876028947434624:12345-192.168.202.32@tcp:400: 00000100:00100000:2.0:1789120818.003599:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2412:x1876028947434624:12345-192.168.202.32@tcp:400: Request processed in 225us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120818.003607:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 196 00000100:00100000:0.0:1789120818.004360:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120818.004506:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947434752 00000100:00100000:3.0:1789120818.004512:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947434752 00000100:00100000:3.0:1789120818.004562:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:3.0:1789120818.004570:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6172:x1876028947434752:12345-192.168.202.32@tcp:33: 00000004:00080000:3.0:1789120818.027945:0:6521:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23282us 00000004:00200000:1.0:1789120818.046482:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789120818.046611:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6172:x1876028947434752:12345-192.168.202.32@tcp:33: Request processed in 42036us (42248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120818.046627:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:3.0:1789120818.299921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120818.300460:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947434880 00000100:00100000:2.0:1789120818.300476:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947434880 00000100:00100000:2.0:1789120818.300615:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789120818.300627:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6211:x1876028947434880:12345-192.168.202.32@tcp:101: 00010000:00010000:2.0:1789120818.300649:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120818.300726:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a830f33b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e8e3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120818.300796:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830f342 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120818.300811:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830f342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120818.300872:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830f342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120818.302039:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789120818.302045:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789120818.302066:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830f342 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120818.302117:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a830f33b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8e3 expref: 8 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120818.302137:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830f342 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8e3 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120818.302146:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946888a7fc00) 00010000:00010000:2.0:1789120818.302149:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789120818.302152:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54600, rc 0) 00000100:00100000:2.0:1789120818.302285:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:6211:x1876028947434880:12345-192.168.202.32@tcp:101: Request processed in 1659us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120818.302365:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:1.0:1789120818.578206:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970551680:0@lo:13: 00000100:00100000:1.0:1789120818.578292:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120818.578479:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120818.578490:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970551808:0@lo:13: 00000100:00100000:0.0:1789120818.578522:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120818.578766:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970551680 00000100:00100000:2.0:1789120818.578774:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970551680 00000100:00100000:2.0:1789120818.578839:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970551808 00000100:00100000:2.0:1789120818.578842:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970551808 00000100:00100000:2.0:1789120818.578861:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789120818.578869:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970551680:12345-0@lo:13: 00002000:00000024:2.0:1789120818.578894:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120818.578942:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970551680:12345-0@lo:13: Request processed in 73us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120818.578950:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789120818.578967:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789120818.578972:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970551808:12345-0@lo:13: 00002000:00000024:2.0:1789120818.578982:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120818.579003:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970551808:12345-0@lo:13: Request processed in 31us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120818.579023:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789120818.579039:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789120818.579067:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467831fa940 x1876028970551680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120818.579088:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970551680:0@lo:13: 00000100:00100000:0.0:1789120818.579165:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970551936:0@lo:13: 00000100:00100000:0.0:1789120818.579196:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789120818.579248:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839efc00 x1876028970551808/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120818.579261:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839efc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970551808:0@lo:13: 00000100:00100000:2.0:1789120818.579378:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970551936 00000100:00100000:2.0:1789120818.579382:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970551936 00000100:00100000:2.0:1789120818.579564:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789120818.579571:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970551936:12345-0@lo:13: 00002000:00000024:2.0:1789120818.579601:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120818.579645:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970551936:12345-0@lo:13: Request processed in 75us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120818.579652:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:1.0:1789120818.580234:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b9c392c0 x1876028970551936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120818.580262:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970551936:0@lo:13: 00000100:00100000:2.0:1789120818.580919:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970552320:0@lo:400: 00000100:00100000:2.0:1789120818.580967:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120818.580992:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970552832:0@lo:400: 00000100:00100000:2.0:1789120818.581017:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120818.581043:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789120818.581049:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970552448:0@lo:400: 00000100:00100000:2.0:1789120818.581072:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120818.581201:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970552960:0@lo:400: 00000100:00100000:2.0:1789120818.581224:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120818.581269:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970552320 00000100:00100000:2.0:1789120818.581275:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970552320 00000100:00100000:2.0:1789120818.581317:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789120818.581325:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970552320:12345-0@lo:400: 00000100:00100000:2.0:1789120818.581389:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970552320:12345-0@lo:400: Request processed in 64us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120818.581407:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789120818.581442:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970552832 00000100:00100000:2.0:1789120818.581446:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970552832 00000100:00100000:3.0:1789120818.581936:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970552448 00000100:00100000:3.0:1789120818.581942:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970552448 00000100:00100000:3.0:1789120818.581983:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970552960 00000100:00100000:3.0:1789120818.581986:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970552960 00000100:00080000:0.0:1789120818.582045:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120818.582050:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789120818.582052:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789120818.582086:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970552192:0@lo:400: 00000100:00100000:0.0:1789120818.582202:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120818.582223:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970552704:0@lo:400: 00000100:00100000:0.0:1789120818.582257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120818.582269:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970553216:0@lo:400: 00000100:00100000:0.0:1789120818.582294:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120818.582330:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789120818.582337:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970552064:0@lo:400: 00000100:00100000:0.0:1789120818.582369:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120818.582390:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970552576:0@lo:400: 00000100:00100000:1.0:1789120818.583165:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970552192 00000100:00100000:1.0:1789120818.583172:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970552192 00000100:00100000:1.0:1789120818.583201:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970552704 00000100:00100000:1.0:1789120818.583204:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970552704 00000100:00100000:1.0:1789120818.583249:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789120818.583260:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970552448:12345-0@lo:400: 00000100:00100000:1.0:1789120818.583318:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938461c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970552448:12345-0@lo:400: Request processed in 60us (2245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120818.583337:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789120818.583358:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789120818.583363:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970552192:12345-0@lo:400: 00000100:00100000:1.0:1789120818.583405:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970552192:12345-0@lo:400: Request processed in 30us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120818.583411:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789120818.583435:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789120818.583442:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970552704:12345-0@lo:400: 00000100:00100000:1.0:1789120818.583470:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970552704:12345-0@lo:400: Request processed in 28us (1213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120818.583476:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1789120818.583492:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120818.583504:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970552064 00000100:00100000:1.0:1789120818.583508:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970552064 00000100:00100000:1.0:1789120818.583535:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789120818.583541:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970552064:12345-0@lo:400: 00000100:00100000:1.0:1789120818.583570:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970552064:12345-0@lo:400: Request processed in 29us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120818.583576:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789120818.583633:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970553216 00000100:00100000:1.0:1789120818.583637:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970553216 00000100:00100000:1.0:1789120818.583669:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789120818.583675:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970553216:12345-0@lo:400: 00000100:00100000:1.0:1789120818.583706:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970553216:12345-0@lo:400: Request processed in 31us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120818.583713:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789120818.583733:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789120818.584180:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120818.584208:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970553088:0@lo:400: 00000100:00100000:0.0:1789120818.584230:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120818.584279:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970552192:0@lo:400: 00000100:00100000:0.0:1789120818.584292:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bced00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970552704:0@lo:400: 00010000:00080000:0.0:1789120818.584304:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468938ea580 x1876028970553216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120818.584314:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970553216:0@lo:400: 00000100:00100000:0.0:1789120818.584340:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970552064:0@lo:400: 00000100:00100000:0.0:1789120818.584361:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970553088 00000100:00100000:0.0:1789120818.584364:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970553088 00000100:00100000:0.0:1789120818.584408:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789120818.584416:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970553088:12345-0@lo:400: 00000100:00100000:0.0:1789120818.584459:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970553088:12345-0@lo:400: Request processed in 45us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120818.584476:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1789120818.584491:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1789120818.584508:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bccf00 x1876028970553088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120818.584518:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970553088:0@lo:400: 00000100:00100000:0.0:1789120818.584559:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970552448:0@lo:400: 00000100:00100000:0.0:1789120818.584571:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970552320:0@lo:400: 00000100:00100000:1.0:1789120818.585743:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970552576 00000100:00100000:1.0:1789120818.585752:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970552576 00000100:00100000:1.0:1789120818.585808:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789120818.585818:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970552576:12345-0@lo:400: 00000100:00100000:1.0:1789120818.585931:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970552576:12345-0@lo:400: Request processed in 114us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120818.585938:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789120818.586350:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970552576:0@lo:400: 00000100:00100000:2.0:1789120818.586572:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789120818.586582:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893846940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970552832:12345-0@lo:400: 00000100:00100000:2.0:1789120818.586629:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893846940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970552832:12345-0@lo:400: Request processed in 50us (5611us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120818.586636:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789120818.586668:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bcd680 x1876028970552832/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120834 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120818.586681:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970552832:0@lo:400: 00000100:00100000:3.0:1789120818.586918:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789120818.586926:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893846d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970552960:12345-0@lo:400: 00000100:00100000:3.0:1789120818.586973:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893846d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970552960:12345-0@lo:400: Request processed in 48us (5748us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120818.586980:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789120818.587155:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970552960:0@lo:400: 00010000:00010000:3.0:1789120818.834145:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120819.092468:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120819.092496:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970553344:0@lo:13: 00000100:00100000:1.0:1789120819.092570:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120819.092817:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970553344 00000100:00100000:3.0:1789120819.092852:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970553344 00000100:00100000:3.0:1789120819.092911:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789120819.092921:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970553344:12345-0@lo:13: 00002000:00000024:3.0:1789120819.092946:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120819.092998:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970553344:12345-0@lo:13: Request processed in 78us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120819.093005:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789120819.093125:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b061c0 x1876028970553344/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120819.093157:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970553344:0@lo:13: 00010000:00010000:3.0:1789120819.858870:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120820.562911:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120820.563792:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947435008 00000100:00100000:0.0:1789120820.563807:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947435008 00000100:00100000:0.0:1789120820.563950:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:0.0:1789120820.563961:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:6263:x1876028947435008:12345-192.168.202.32@tcp:41: 00000004:00000024:0.0:1789120820.564001:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1789120820.564080:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938452c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:6263:x1876028947435008:12345-192.168.202.32@tcp:41: Request processed in 120us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120820.564087:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00080000:1.0:1789120820.564284:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120820.566921:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120820.571687:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947435136 00000100:00100000:3.0:1789120820.571706:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947435136 00000100:00100000:3.0:1789120820.571854:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:3.0:1789120820.571868:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6263:x1876028947435136:12345-192.168.202.32@tcp:41: 00000004:00000024:3.0:1789120820.571922:0:9342:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789120820.573605:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6263:x1876028947435136:12345-192.168.202.32@tcp:41: Request processed in 1609us (6567us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120820.573620:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00080000:1.0:1789120820.573861:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789120820.577559:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120820.577898:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947435264 00000100:00100000:2.0:1789120820.577909:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947435264 00000100:00080000:1.0:1789120820.577984:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120820.577987:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:2.0:1789120820.577999:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6263:x1876028947435264:12345-192.168.202.32@tcp:13: 00002000:00000024:2.0:1789120820.578037:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120820.578118:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6263:x1876028947435264:12345-192.168.202.32@tcp:13: Request processed in 122us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120820.578124:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:0.0:1789120820.581637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120820.581864:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947435392 00000100:00100000:3.0:1789120820.581876:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947435392 00000100:00100000:3.0:1789120820.581962:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789120820.581974:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6263:x1876028947435392:12345-192.168.202.32@tcp:13: 00002000:00000024:3.0:1789120820.582048:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120820.582120:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ede00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:6263:x1876028947435392:12345-192.168.202.32@tcp:13: Request processed in 148us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120820.582129:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00080000:1.0:1789120820.582357:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1789120820.882410:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120821.651419:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970553472:0@lo:41: 00000100:00100000:3.0:1789120821.651520:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120821.651567:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970553472 00000100:00100000:2.0:1789120821.651590:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970553472 00000100:00100000:2.0:1789120821.651656:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789120821.651668:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970553472:12345-0@lo:41: 00000004:00000024:2.0:1789120821.651713:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1789120821.651789:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970553472:12345-0@lo:41: Request processed in 122us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120821.651797:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789120821.651869:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970553472:0@lo:41: 00000001:00100000:3.0:1789120821.654959:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000100:00100000:1.0:1789120821.666159:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120821.666199:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970553600:0@lo:41: 00000100:00100000:1.0:1789120821.666300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120821.666463:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970553600 00000100:00100000:2.0:1789120821.666473:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970553600 00000100:00100000:2.0:1789120821.666544:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789120821.666556:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970553600:12345-0@lo:41: 00000004:00000024:2.0:1789120821.666607:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120821.666665:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970553600:12345-0@lo:41: Request processed in 111us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120821.666674:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789120821.666777:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970553600:0@lo:41: 00010000:00010000:3.0:1789120821.906184:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789120822.681969:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000001:00100000:2.0:1789120822.685861:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000001:02000400:2.0:1789120822.795287:0:10187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789120822.935049:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120823.254179:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120823.254348:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120823.254626:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947435520 00000100:00100000:1.0:1789120823.254640:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120823.254642:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947435520 00000100:00100000:1.0:1789120823.254700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120823.254719:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 198 00000100:00100000:1.0:1789120823.254729:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120823.254730:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2411:x1876028947435520:12345-192.168.202.32@tcp:400: 00000100:00100000:1.0:1789120823.254758:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947435776 00000100:00100000:1.0:1789120823.254761:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947435776 00000100:00100000:1.0:1789120823.254797:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947435648 00000100:00100000:1.0:1789120823.254800:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947435648 00000100:00100000:2.0:1789120823.254841:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2411:x1876028947435520:12345-192.168.202.32@tcp:400: Request processed in 91us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120823.254846:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:2.0:1789120823.254849:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 198 00000100:00100000:1.0:1789120823.254854:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947435776:12345-192.168.202.32@tcp:400: 00000100:00100000:2.0:1789120823.254884:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:2.0:1789120823.254891:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947435648:12345-192.168.202.32@tcp:400: 00000100:00100000:1.0:1789120823.254896:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947435776:12345-192.168.202.32@tcp:400: Request processed in 44us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120823.254902:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:2.0:1789120823.254913:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947435648:12345-192.168.202.32@tcp:400: Request processed in 23us (213us total) trans 0 rc 0/0 00000100:00080000:1.0:1789120823.254920:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120823.254924:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789120823.255066:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:0.0:1789120823.255320:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947436032 00000100:00100000:0.0:1789120823.255341:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947436032 00000100:00100000:0.0:1789120823.255400:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947435904 00000100:00100000:0.0:1789120823.255403:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947435904 00000100:00100000:0.0:1789120823.255428:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789120823.255436:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947436032:12345-192.168.202.32@tcp:400: 00000100:00100000:0.0:1789120823.255482:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947436032:12345-192.168.202.32@tcp:400: Request processed in 47us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120823.255496:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789120823.255509:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:0.0:1789120823.255515:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947435904:12345-192.168.202.32@tcp:400: 00000100:00100000:0.0:1789120823.255542:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947435904:12345-192.168.202.32@tcp:400: Request processed in 26us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120823.255548:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00080000:1.0:1789120823.256179:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120823.256184:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120823.698235:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120823.698288:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970553728:0@lo:13: 00000100:00100000:3.0:1789120823.698368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120823.698688:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970553728 00000100:00100000:0.0:1789120823.698699:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970553728 00000100:00100000:0.0:1789120823.698774:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789120823.698784:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970553728:12345-0@lo:13: 00002000:00000024:0.0:1789120823.698844:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120823.698899:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970553728:12345-0@lo:13: Request processed in 117us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120823.698907:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1789120823.699228:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120823.699248:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970553856:0@lo:13: 00000100:00100000:1.0:1789120823.699472:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970554240:0@lo:400: 00000100:00100000:1.0:1789120823.699513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120823.699537:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970554752:0@lo:400: 00000100:00100000:3.0:1789120823.700543:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970553984:0@lo:13: 00000100:00100000:0.0:1789120823.700696:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120823.700756:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970554368:0@lo:400: 00000100:00100000:3.0:1789120823.700894:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120823.700921:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970554496:0@lo:400: 00000100:00100000:0.0:1789120823.700960:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120823.700963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120823.701281:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970554368 00000100:00100000:2.0:1789120823.701290:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970554368 00000100:00100000:2.0:1789120823.701402:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789120823.701413:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970554368:12345-0@lo:400: 00000100:00100000:3.0:1789120823.702713:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970555008:0@lo:400: 00000100:00100000:0.0:1789120823.702815:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970554880:0@lo:400: 00000100:00100000:1.0:1789120823.702880:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120823.702916:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120823.702930:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970555264:0@lo:400: 00000100:00100000:3.0:1789120823.702959:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970555520:0@lo:400: 00000100:00100000:0.0:1789120823.702971:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120823.706469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120823.706523:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789120823.706536:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970554112:0@lo:400: 00000100:00100000:1.0:1789120823.706596:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120823.706631:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970554624:0@lo:400: 00000100:00100000:1.0:1789120823.706653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120823.706663:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970555136:0@lo:400: 00000100:00100000:1.0:1789120823.706700:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120823.706730:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970554240 00000100:00100000:1.0:1789120823.706737:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970554240 00000100:00100000:1.0:1789120823.706771:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970554496 00000100:00100000:1.0:1789120823.706774:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970554496 00000100:00100000:1.0:1789120823.706783:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970554752 00000100:00100000:1.0:1789120823.706785:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970554752 00000100:00100000:1.0:1789120823.706989:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970554880 00000100:00100000:1.0:1789120823.706994:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970554880 00000100:00100000:3.0:1789120823.707013:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120823.707019:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970555264 00000100:00100000:0.0:1789120823.707020:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970555392:0@lo:400: 00000100:00100000:1.0:1789120823.707026:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970555264 00000100:00100000:1.0:1789120823.707050:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970555136 00000100:00100000:1.0:1789120823.707053:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970555136 00000100:00100000:1.0:1789120823.707084:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789120823.707084:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120823.707095:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970554368:12345-0@lo:400: Request processed in 5682us (6140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120823.707110:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789120823.707135:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970555008 00000100:00100000:2.0:1789120823.707138:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970554624 00000100:00100000:0.0:1789120823.707141:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970555008 00000100:00100000:2.0:1789120823.707144:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970554624 00000100:00100000:3.0:1789120823.707159:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789120823.707172:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789120823.707183:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970554496:12345-0@lo:400: 00000100:00100000:2.0:1789120823.707193:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970554624:12345-0@lo:400: 00000100:00100000:0.0:1789120823.707195:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970555520 00000100:00100000:0.0:1789120823.707202:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970555520 00000100:00100000:0.0:1789120823.707225:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970555392 00000100:00100000:0.0:1789120823.707229:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970555392 00000100:00100000:0.0:1789120823.707267:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789120823.707278:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970554624:12345-0@lo:400: Request processed in 94us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120823.707291:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789120823.707292:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970555008:12345-0@lo:400: 00000100:00100000:3.0:1789120823.707316:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970554496:12345-0@lo:400: Request processed in 142us (6351us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.707327:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789120823.707352:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b06580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970555008:12345-0@lo:400: Request processed in 75us (4445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120823.707364:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970554240:12345-0@lo:400: 00000100:00100000:0.0:1789120823.707380:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789120823.707383:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789120823.707400:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970554752:12345-0@lo:400: 00000100:00100000:0.0:1789120823.707412:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120823.707425:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970555520:12345-0@lo:400: 00000100:00100000:1.0:1789120823.707431:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970554240:12345-0@lo:400: Request processed in 336us (7916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120823.707441:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789120823.707468:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789120823.707476:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970554880:12345-0@lo:400: 00000100:00100000:2.0:1789120823.708485:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789120823.708497:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970555392:12345-0@lo:400: 00000100:00100000:0.0:1789120823.712461:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970555520:12345-0@lo:400: Request processed in 5031us (5448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120823.713008:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789120823.713074:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970553856 00000100:00100000:0.0:1789120823.713083:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970553856 00000100:00100000:0.0:1789120823.713113:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970553984 00000100:00100000:0.0:1789120823.713117:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970553984 00000100:00100000:0.0:1789120823.713132:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789120823.713139:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970553856:12345-0@lo:13: 00002000:00000024:0.0:1789120823.713172:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120823.713190:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970554752:12345-0@lo:400: Request processed in 5786us (10301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.713207:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789120823.713249:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970553856:12345-0@lo:13: Request processed in 96us (12540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120823.713258:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789120823.713276:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789120823.713294:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970555264:12345-0@lo:400: 00000100:00100000:3.0:1789120823.713384:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970555264:12345-0@lo:400: Request processed in 98us (6923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.713390:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789120823.713408:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789120823.713416:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970555136:12345-0@lo:400: 00000100:00100000:3.0:1789120823.713475:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970555136:12345-0@lo:400: Request processed in 60us (6773us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.713481:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789120823.713535:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789120823.713544:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970553984:12345-0@lo:13: 00002000:00000024:3.0:1789120823.713572:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120823.713609:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970553984:12345-0@lo:13: Request processed in 67us (12716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.713616:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1789120823.713672:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ec780 x1876028970553728/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120823.713698:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970553728:0@lo:13: 00010000:00080000:3.0:1789120823.713743:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ecb40 x1876028970553984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120823.713759:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970553984:0@lo:13: 00000100:00100000:3.0:1789120823.713775:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970554496:0@lo:400: 00010000:00080000:3.0:1789120823.713787:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b383c0 x1876028970555008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120823.713795:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970555008:0@lo:400: 00010000:00080000:3.0:1789120823.713808:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783cf8f00 x1876028970555520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120823.713817:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970555520:0@lo:400: 00000001:00100000:3.0:1789120823.713959:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000100:00100000:3.0:1789120823.714010:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970554112 00000100:00100000:3.0:1789120823.714016:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970554112 00000100:00100000:3.0:1789120823.714067:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789120823.714073:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970554112:12345-0@lo:400: 00000100:00100000:3.0:1789120823.714111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970554112:12345-0@lo:400: Request processed in 38us (7514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120823.714117:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789120823.714420:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970554112:0@lo:400: 00000100:00100000:3.0:1789120823.714436:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970554624:0@lo:400: 00000100:00100000:3.0:1789120823.714449:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eaed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970555136:0@lo:400: 00000100:00100000:3.0:1789120823.714463:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970554240:0@lo:400: 00000100:00100000:3.0:1789120823.714479:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970554752:0@lo:400: 00010000:00080000:3.0:1789120823.714493:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783cf8000 x1876028970555264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120823.714595:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970555264:0@lo:400: 00000100:00080000:3.0:1789120823.714640:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120823.714645:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789120823.714649:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120823.714651:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120823.715427:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970554880:12345-0@lo:400: Request processed in 7943us (12452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120823.715441:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1789120823.715667:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf662580 x1876028970553856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120823.715690:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970553856:0@lo:13: 00000100:00100000:3.0:1789120823.715721:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970554368:0@lo:400: 00010000:00080000:3.0:1789120823.715732:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b3bc00 x1876028970554880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120823.715904:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970554880:0@lo:400: 00000100:00100000:2.0:1789120823.716750:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970555392:12345-0@lo:400: Request processed in 8249us (9666us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120823.716763:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789120823.716918:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783cfa940 x1876028970555392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120839 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120823.716933:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970555392:0@lo:400: 00010000:00010000:3.0:1789120823.960409:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120824.215230:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970555648:0@lo:13: 00000100:00100000:1.0:1789120824.215309:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120824.215688:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970555648 00000100:00100000:0.0:1789120824.215697:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970555648 00000100:00100000:0.0:1789120824.215778:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789120824.215789:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970555648:12345-0@lo:13: 00002000:00000024:0.0:1789120824.215849:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120824.215900:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970555648:12345-0@lo:13: Request processed in 113us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120824.215907:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789120824.215979:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bcf0c0 x1876028970555648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120824.215999:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970555648:0@lo:13: 00010000:00010000:3.0:1789120824.979195:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120826.034530:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789120826.304162:0:10335:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd339fa4c0 20000000:00000080:2.0:1789120826.304182:0:10335:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff946782af2400 uarg=0000000000000000 20000000:01000000:2.0:1789120826.304234:0:10335:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789120826.304241:0:10335:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789120826.304244:0:10335:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789120826.304249:0:10335:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789120826.304254:0:10335:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789120826.304314:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789120826.304318:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789120826.307336:0:10336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:1.0:1789120826.308487:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:1.0:1789120826.308721:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:1.0:1789120826.308740:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 20000000:01000000:1.0:1789120826.308763:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789120826.308765:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789120826.309178:0:10337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:1.0:1789120826.309386:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:1.0:1789120826.309406:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:1.0:1789120826.309422:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:1.0:1789120826.309430:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789120826.309432:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789120826.310363:0:10338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:1.0:1789120826.310713:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:1.0:1789120826.310751:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:1.0:1789120826.310765:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:1.0:1789120826.310774:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789120826.310776:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789120826.311383:0:10339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:1.0:1789120826.311683:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:1.0:1789120826.311705:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:1.0:1789120826.311721:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:1.0:1789120826.311730:0:10335:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789120826.311732:0:10335:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789120826.314674:0:10340:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:1.0:1789120826.315074:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:1.0:1789120826.315102:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:1.0:1789120826.315115:0:10335:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 10000000:01000000:1.0:1789120826.315130:0:10335:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789120826.315153:0:10335:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315170:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f1dd expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315178:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a54c00/0xb74d2367a830f20e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f207 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315185:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f24d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f246 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315210:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946887082e00/0xb74d2367a830f25b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f254 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315217:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a55200/0xb74d2367a830f269 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f262 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315224:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a55e00/0xb74d2367a830f285 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f27e expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315230:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a54a00/0xb74d2367a830f2a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f2a1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315236:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946887083200/0xb74d2367a830f2cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f2c4 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315243:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468a2f11a00/0xb74d2367a830f2f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f2ee expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315325:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468a2f10400/0xb74d2367a830f303 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e873 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315335:0:10335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a55600/0xb74d2367a830f30a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e87a expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315343:0:10335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315390:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a55600/0xb74d2367a830f30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e87a expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315413:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946899a55600/0xb74d2367a830f30a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e87a expref: 9 pid: 6512 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.315428:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970555776:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120826.315703:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468a2f10400/0xb74d2367a830f303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e873 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315712:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468a2f10400/0xb74d2367a830f303 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e873 expref: 9 pid: 6513 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.315722:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970555904:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120826.315754:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468a2f11a00/0xb74d2367a830f2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f2ee expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315763:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468a2f11a00/0xb74d2367a830f2f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f2ee expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.315772:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556032:0@lo:104: 00000100:00100000:1.0:1789120826.315812:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120826.315942:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946887083200/0xb74d2367a830f2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f2c4 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.315950:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946887083200/0xb74d2367a830f2cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f2c4 expref: 23 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.315959:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556160:0@lo:104: 00000100:00100000:1.0:1789120826.315979:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120826.316021:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a54a00/0xb74d2367a830f2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f2a1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.316029:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946899a54a00/0xb74d2367a830f2a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f2a1 expref: 23 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.316037:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556288:0@lo:104: 00000100:00100000:1.0:1789120826.316078:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120826.316094:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a55e00/0xb74d2367a830f285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f27e expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.316101:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946899a55e00/0xb74d2367a830f285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f27e expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.316108:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556416:0@lo:104: 00000100:00100000:1.0:1789120826.316129:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120826.316143:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a55200/0xb74d2367a830f269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f262 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.316151:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946899a55200/0xb74d2367a830f269 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f262 expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.316160:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556544:0@lo:104: 00010000:00010000:1.0:1789120826.316193:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946887082e00/0xb74d2367a830f25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f254 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.316201:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946887082e00/0xb74d2367a830f25b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f254 expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.316209:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b91a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556672:0@lo:104: 00010000:00010000:1.0:1789120826.316246:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f246 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120826.316388:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789120826.316407:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120826.316419:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120826.316428:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970556032 00000100:00100000:2.0:1789120826.316435:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970556032 00000100:00100000:2.0:1789120826.316485:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970556160 00000100:00100000:2.0:1789120826.316489:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970556160 00000100:00100000:2.0:1789120826.316512:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970556288 00000100:00100000:2.0:1789120826.316514:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970556288 00000100:00100000:2.0:1789120826.316523:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970556416 00000100:00100000:2.0:1789120826.316525:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970556416 00000100:00100000:2.0:1789120826.316534:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970556544 00000100:00100000:2.0:1789120826.316536:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970556544 00000100:00100000:2.0:1789120826.316544:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970556672 00000100:00100000:2.0:1789120826.316546:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970556672 00000100:00100000:2.0:1789120826.316559:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789120826.316567:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+8:10335:x1876028970556032:12345-0@lo:104: 00010000:00010000:2.0:1789120826.316582:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.316635:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120826.316641:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+8:10335:x1876028970556032:12345-0@lo:104: Request processed in 75us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120826.316654:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789120826.316670:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789120826.316675:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+7:10335:x1876028970556160:12345-0@lo:104: 00010000:00010000:2.0:1789120826.316683:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.316716:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789120826.316721:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+7:10335:x1876028970556160:12345-0@lo:104: Request processed in 47us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120826.316726:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789120826.316736:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789120826.316743:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+6:10335:x1876028970556288:12345-0@lo:104: 00010000:00010000:2.0:1789120826.316749:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.316780:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789120826.316786:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfa940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+6:10335:x1876028970556288:12345-0@lo:104: Request processed in 44us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120826.316791:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789120826.316803:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789120826.316809:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9a65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+5:10335:x1876028970556416:12345-0@lo:104: 00010000:00010000:2.0:1789120826.316816:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.316879:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789120826.316883:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9a65450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+5:10335:x1876028970556416:12345-0@lo:104: Request processed in 76us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120826.316894:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789120826.316930:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789120826.316936:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf6603c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:10335:x1876028970556544:12345-0@lo:104: 00010000:00010000:2.0:1789120826.316943:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.316969:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789120826.316973:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf6603c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:10335:x1876028970556544:12345-0@lo:104: Request processed in 38us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120826.316978:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789120826.316989:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789120826.316995:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:10335:x1876028970556672:12345-0@lo:104: 00010000:00010000:2.0:1789120826.317001:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.317023:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789120826.317028:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:10335:x1876028970556672:12345-0@lo:104: Request processed in 34us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120826.317033:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1789120826.317052:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789120826.317058:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.317066:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887082600 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120826.317070:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.317088:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120826.317095:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120826.317102:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120826.317128:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.317135:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120826.317154:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.317161:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887082600/0xb74d2367a830f2ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f2f5 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.317174:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789120826.317177:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.317182:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887083600 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120826.317185:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.317192:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120826.317198:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120826.317210:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120826.317224:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.317230:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120826.317246:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.317662:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f24d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f246 expref: 23 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.317678:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556800:0@lo:104: 00000100:00100000:1.0:1789120826.317726:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120826.317774:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a54c00/0xb74d2367a830f20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f207 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.317783:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946899a54c00/0xb74d2367a830f20e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f207 expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.317791:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970557184:0@lo:104: 00000100:00100000:1.0:1789120826.317809:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120826.317842:0:10335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f1dd expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.317851:0:10335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f1dd expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.317859:0:10335:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970557312:0@lo:104: 00000100:00100000:1.0:1789120826.317879:0:10335:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120826.317890:0:10335:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468918010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120826.317914:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf8b40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556032:0@lo:104: 00000100:00100000:1.0:1789120826.317922:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfb840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556160:0@lo:104: 00000100:00100000:1.0:1789120826.317929:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf9680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556288:0@lo:104: 00000100:00100000:1.0:1789120826.317935:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556416:0@lo:104: 00000100:00100000:1.0:1789120826.317950:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf8f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556544:0@lo:104: 00000100:00100000:1.0:1789120826.317957:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b91a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556672:0@lo:104: 00000100:00100000:3.0:1789120826.318061:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970556800 00000100:00100000:3.0:1789120826.318067:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970556800 00000100:00100000:3.0:1789120826.318096:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970557184 00000100:00100000:3.0:1789120826.318099:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970557184 00000100:00100000:3.0:1789120826.318108:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970557312 00000100:00100000:3.0:1789120826.318110:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970557312 00000100:00100000:3.0:1789120826.318123:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789120826.318129:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+5:10335:x1876028970556800:12345-0@lo:104: 00010000:00010000:3.0:1789120826.318138:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.318181:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789120826.318186:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+5:10335:x1876028970556800:12345-0@lo:104: Request processed in 57us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120826.318193:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789120826.318209:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789120826.318215:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b93840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:10335:x1876028970557184:12345-0@lo:104: 00010000:00010000:3.0:1789120826.318222:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.318247:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789120826.318354:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b93840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:10335:x1876028970557184:12345-0@lo:104: Request processed in 129us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120826.318361:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789120826.318375:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789120826.318381:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:10335:x1876028970557312:12345-0@lo:104: 00010000:00010000:3.0:1789120826.318389:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.318416:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1789120826.318421:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:10335:x1876028970557312:12345-0@lo:104: Request processed in 41us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120826.318427:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789120826.319386:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970556928:0@lo:103: 00000100:00100000:3.0:1789120826.319436:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120826.319596:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887083600/0xb74d2367a830f2c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f2cb expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319613:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789120826.319617:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319623:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120826.319627:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319636:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120826.319642:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120826.319647:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120826.319678:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319685:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120826.319705:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319712:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a830f2a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f2a8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319721:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789120826.319725:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319731:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54800 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120826.319734:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319742:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120826.319747:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120826.319751:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120826.319763:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319769:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120826.319780:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319786:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a54800/0xb74d2367a830f27e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f285 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319793:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789120826.319802:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319807:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c2048a00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120826.319810:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319816:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120826.319838:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120826.319843:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120826.319857:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319863:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120826.319868:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319874:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c2048a00/0xb74d2367a830f262 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f269 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319886:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789120826.319889:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319894:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f10e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120826.319896:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319912:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120826.319917:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120826.319921:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120826.319934:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319939:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120826.319944:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319950:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468a2f10e00/0xb74d2367a830f254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f25b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319958:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789120826.319961:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319966:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120826.319968:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.319974:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120826.319980:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120826.319992:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120826.320005:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320010:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120826.320014:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320021:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468a2f11000/0xb74d2367a830f246 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f24d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320031:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789120826.320034:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320040:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887083800 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120826.320042:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320049:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120826.320054:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120826.320059:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120826.320070:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320076:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120826.320086:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320092:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887083800/0xb74d2367a830f207 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f20e expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320101:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120826.320105:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320110:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55a00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120826.320113:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320119:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120826.320125:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120826.320129:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789120826.320142:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320148:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120826.320152:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320158:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a55a00/0xb74d2367a830f1dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f1e4 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.320172:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120826.320179:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120826.320181:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120826.320194:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970557568:0@lo:103: 00000100:00100000:2.0:1789120826.320229:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120826.320398:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970556800:0@lo:104: 00000100:00100000:1.0:1789120826.320409:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970557184:0@lo:104: 00000100:00100000:1.0:1789120826.320418:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970557312:0@lo:104: 00010000:00010000:3.0:1789120826.320569:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120826.320578:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120826.320584:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120826.320598:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970556928 00000100:00100000:3.0:1789120826.320604:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970556928 00010000:00010000:3.0:1789120826.320634:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468a2f11a00/0xb74d2367a830f2f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f2ee expref: 24 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120826.320661:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970557568 00000100:00100000:3.0:1789120826.320664:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970557568 00010000:00010000:3.0:1789120826.320674:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a55e00/0xb74d2367a830f285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f27e expref: 25 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120826.320691:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789120826.320699:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+25:3647:x1876028970556928:12345-0@lo:103: 00010000:00010000:3.0:1789120826.320720:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120826.320726:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468a2f11a00/0xb74d2367a830f2f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f2ee expref: 25 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.320735:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468a2f11a00/0xb74d2367a830f2f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f2ee expref: 25 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.320750:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468a2f11a00/0xb74d2367a830f2f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f2ee expref: 25 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.320761:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120826.320792:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970556928:12345-0@lo:103: Request processed in 94us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120826.320799:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789120826.320860:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789120826.320866:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf663c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+23:3646:x1876028970557568:12345-0@lo:103: 00010000:00010000:3.0:1789120826.320873:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120826.320878:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a55e00/0xb74d2367a830f285 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f27e expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.320886:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a55e00/0xb74d2367a830f285 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f27e expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.320896:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55e00/0xb74d2367a830f285 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f27e expref: 23 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.320905:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120826.320925:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf663c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+22:3646:x1876028970557568:12345-0@lo:103: Request processed in 59us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120826.320940:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789120826.322081:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970557440:0@lo:103: 00000100:00100000:0.0:1789120826.322135:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120826.322177:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970557952:0@lo:103: 00000100:00100000:0.0:1789120826.322197:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120826.322221:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789120826.322228:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf663840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970557056:0@lo:103: 00000100:00100000:0.0:1789120826.322247:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120826.322423:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970557824:0@lo:103: 00000100:00100000:0.0:1789120826.322446:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120826.323394:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970557440 00000100:00100000:0.0:1789120826.323407:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970557440 00010000:00010000:0.0:1789120826.323455:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a54a00/0xb74d2367a830f2a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f2a1 expref: 22 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120826.323492:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970557952 00000100:00100000:1.0:1789120826.324566:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970557056 00000100:00100000:1.0:1789120826.324575:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970557056 00010000:00010000:1.0:1789120826.325058:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946887083200/0xb74d2367a830f2cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f2c4 expref: 23 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.325079:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970557824 00000100:00100000:1.0:1789120826.325083:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970557824 00010000:00010000:1.0:1789120826.325096:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946887082e00/0xb74d2367a830f25b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f254 expref: 24 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.325110:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789120826.325119:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970557440:12345-0@lo:103: 00010000:00010000:1.0:1789120826.325132:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120826.325138:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a54a00/0xb74d2367a830f2a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f2a1 expref: 24 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.325149:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a54a00/0xb74d2367a830f2a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f2a1 expref: 24 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.325165:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a54a00/0xb74d2367a830f2a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f2a1 expref: 24 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.325182:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120826.325671:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970557952 00010000:00010000:0.0:1789120826.325691:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f24d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f246 expref: 24 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120826.325708:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789120826.325715:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970557056:12345-0@lo:103: 00010000:00010000:0.0:1789120826.325723:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120826.325734:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946887083200/0xb74d2367a830f2cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f2c4 expref: 24 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120826.325743:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946887083200/0xb74d2367a830f2cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f2c4 expref: 24 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120826.325754:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887083200/0xb74d2367a830f2cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f2c4 expref: 24 pid: 6513 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120826.325776:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120826.325895:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+23:3645:x1876028970557440:12345-0@lo:103: Request processed in 777us (3759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120826.325904:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789120826.325922:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789120826.325929:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+22:3645:x1876028970557824:12345-0@lo:103: 00010000:00010000:1.0:1789120826.325937:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120826.325941:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946887082e00/0xb74d2367a830f25b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f254 expref: 22 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.325949:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946887082e00/0xb74d2367a830f25b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f254 expref: 22 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.325959:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887082e00/0xb74d2367a830f25b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f254 expref: 22 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.325968:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120826.326211:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970557568:0@lo:103: 00000100:00100000:2.0:1789120826.326226:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970558080:0@lo:103: 00000100:00100000:2.0:1789120826.326264:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120826.326359:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bced00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+21:3645:x1876028970557056:12345-0@lo:103: Request processed in 643us (4109us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120826.326367:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789120826.326454:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789120826.326476:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+20:3645:x1876028970557952:12345-0@lo:103: 00010000:00010000:3.0:1789120826.326484:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120826.326490:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f24d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f246 expref: 20 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.326509:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f24d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f246 expref: 20 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.326519:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f24d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f246 expref: 20 pid: 6510 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120826.326528:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120826.327188:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bccf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+19:3645:x1876028970557952:12345-0@lo:103: Request processed in 713us (4988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120826.327198:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789120826.327235:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970558080 00000100:00100000:0.0:1789120826.327240:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970558080 00000100:00100000:2.0:1789120826.327249:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:0.0:1789120826.327264:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a54c00/0xb74d2367a830f20e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f207 expref: 19 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120826.327278:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970557696:0@lo:103: 00000100:00100000:0.0:1789120826.327284:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789120826.327291:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf662580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+19:3646:x1876028970558080:12345-0@lo:103: 00010000:00010000:0.0:1789120826.327299:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120826.327303:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a54c00/0xb74d2367a830f20e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f207 expref: 19 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120826.327312:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a54c00/0xb74d2367a830f20e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f207 expref: 19 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120826.327317:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120826.327331:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a54c00/0xb74d2367a830f20e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f207 expref: 19 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120826.327334:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970558208:0@lo:103: 00010000:00010000:0.0:1789120826.327359:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120826.327373:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120826.327400:0:6503:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:2.0:1789120826.327409:0:6503:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1789120826.327413:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf662580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+18:3646:x1876028970558080:12345-0@lo:103: Request processed in 121us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120826.327420:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789120826.327433:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970557696 00000100:00100000:0.0:1789120826.327436:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970557696 00010000:00010000:0.0:1789120826.327447:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a55200/0xb74d2367a830f269 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f262 expref: 18 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120826.327469:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970558208 00000100:00100000:0.0:1789120826.327472:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970558208 00010000:00010000:0.0:1789120826.327490:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f1dd expref: 19 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120826.327513:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789120826.327520:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+19:3646:x1876028970557696:12345-0@lo:103: 00010000:00010000:0.0:1789120826.327527:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120826.327530:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a55200/0xb74d2367a830f269 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f262 expref: 19 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120826.327537:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a55200/0xb74d2367a830f269 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f262 expref: 19 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120826.327547:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55200/0xb74d2367a830f269 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f262 expref: 19 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120826.327557:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120826.327579:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+18:3646:x1876028970557696:12345-0@lo:103: Request processed in 60us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120826.327585:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789120826.327595:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789120826.327599:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf663480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+17:3646:x1876028970558208:12345-0@lo:103: 00000100:00100000:1.0:1789120826.327670:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+17:3645:x1876028970557824:12345-0@lo:103: Request processed in 1741us (5222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120826.327678:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789120826.327734:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf9a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970555776:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789120826.327745:0:10335:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf83c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10335:1876028970555904:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120826.327793:0:10335:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120826.327811:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120826.327817:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f1dd expref: 16 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120826.327842:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f1dd expref: 16 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120826.327852:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468a2f10800/0xb74d2367a830f1e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f1dd expref: 16 pid: 6512 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120826.327861:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120826.327886:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf663480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+15:3646:x1876028970558208:12345-0@lo:103: Request processed in 287us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120826.327892:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789120826.327976:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf663840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970557056:0@lo:103: 00000100:00100000:0.0:1789120826.327984:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970557824:0@lo:103: 00000100:00100000:0.0:1789120826.327991:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970557440:0@lo:103: 00000100:00100000:0.0:1789120826.327998:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970557952:0@lo:103: 00000100:00100000:2.0:1789120826.328667:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970556928:0@lo:103: 00000100:00100000:2.0:1789120826.328695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120826.328746:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947436160 00000100:00100000:1.0:1789120826.328752:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947436160 00010000:00010000:1.0:1789120826.329084:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a55600/0xb74d2367a830f30a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e87a expref: 10 pid: 6512 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120826.329133:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:1.0:1789120826.329142:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2412:x1876028947436160:12345-192.168.202.32@tcp:103: 00010000:00010000:1.0:1789120826.329152:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120826.329157:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a55600/0xb74d2367a830f30a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e87a expref: 10 pid: 6512 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.329168:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a55600/0xb74d2367a830f30a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e87a expref: 10 pid: 6512 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.329182:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55600/0xb74d2367a830f30a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e87a expref: 10 pid: 6512 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.329194:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120826.329235:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835ef850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+9:2412:x1876028947436160:12345-192.168.202.32@tcp:103: Request processed in 94us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120826.329241:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:2.0:1789120826.333915:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120826.333962:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947436288 00000100:00100000:2.0:1789120826.333972:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947436288 00010000:00010000:2.0:1789120826.334012:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468a2f10400/0xb74d2367a830f303 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e873 expref: 9 pid: 6513 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120826.334061:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:2.0:1789120826.334071:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75b5d71e-0e31-479d-b240-b6a98d05b974+9:2412:x1876028947436288:12345-192.168.202.32@tcp:103: 00010000:00010000:2.0:1789120826.334086:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120826.334092:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468a2f10400/0xb74d2367a830f303 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e873 expref: 9 pid: 6513 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334120:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468a2f10400/0xb74d2367a830f303 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e873 expref: 9 pid: 6513 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334139:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468a2f10400/0xb74d2367a830f303 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e873 expref: 9 pid: 6513 timeout: 376 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334155:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334164:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334179:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334186:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334192:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334199:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334204:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789120826.334208:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334216:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334250:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120826.334269:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120826.334319:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75b5d71e-0e31-479d-b240-b6a98d05b974+8:2412:x1876028947436288:12345-192.168.202.32@tcp:103: Request processed in 249us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120826.334328:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00010000:00010000:1.0:1789120826.334391:0:10335:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.334408:0:10335:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120826.334414:0:10335:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f349 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120826.335982:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970557696:0@lo:103: 00000100:00100000:3.0:1789120826.335996:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970558208:0@lo:103: 00000100:00100000:3.0:1789120826.336003:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970558080:0@lo:103: 00000100:00100000:0.0:1789120826.771869:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970558336:0@lo:41: 00000100:00100000:0.0:1789120826.771945:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120826.772885:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970558336 00000100:00100000:3.0:1789120826.772895:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970558336 00000100:00100000:3.0:1789120826.772965:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789120826.772976:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970558336:12345-0@lo:41: 00000004:00000024:3.0:1789120826.773018:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789120826.773164:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970558336:12345-0@lo:41: Request processed in 190us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120826.773186:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789120826.773302:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970558336:0@lo:41: 00000100:00100000:0.0:1789120826.776423:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970558464:0@lo:41: 00000100:00100000:0.0:1789120826.776554:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120826.776703:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970558464 00000100:00100000:3.0:1789120826.776711:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970558464 00000100:00100000:3.0:1789120826.776762:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789120826.776771:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970558464:12345-0@lo:41: 00000004:00000024:3.0:1789120826.776803:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789120826.780535:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970558464:12345-0@lo:41: Request processed in 3754us (3971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120826.780549:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789120826.784309:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970558464:0@lo:41: 00010000:00010000:2.0:1789120827.093702:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120828.114086:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789120828.177993:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789120828.178001:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946782aee800 from 48 10000000:01000000:3.0:1789120828.178006:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789120828.178059:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.178070:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.178082:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120828.178106:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970558592:0@lo:101: 00000100:00100000:3.0:1789120828.178177:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.178251:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a05090c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.178259:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970558592 00000100:00100000:2.0:1789120828.178269:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970558592 00000100:00100000:2.0:1789120828.178349:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789120828.178361:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+15:6515:x1876028970558592:12345-0@lo:101: 00010000:00010000:2.0:1789120828.178376:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120828.178391:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1a00/0xb74d2367a830f357 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f350 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.178416:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1a00/0xb74d2367a830f357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f350 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.178426:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1a00/0xb74d2367a830f357 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f350 expref: 16 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.178435:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1a00, rc 0) 00000100:00100000:2.0:1789120828.178538:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970558592:12345-0@lo:101: Request processed in 179us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.178545:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1789120828.178771:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970558592:0@lo:101: 00010000:00010000:0.0:1789120828.178786:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.178809:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120828.178904:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970558720:0@lo:501: 00000100:00100000:0.0:1789120828.178935:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.179031:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99df00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.179276:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970558720 00000100:00100000:1.0:1789120828.179287:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970558720 00000100:00100000:1.0:1789120828.179365:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789120828.179373:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970558720:12345-0@lo:501: 00000100:00100000:1.0:1789120828.179504:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970558720:12345-0@lo:501: Request processed in 132us (568us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.179511:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789120828.179573:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970558720:0@lo:501: 00000100:00100000:0.0:1789120828.179603:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970558848:0@lo:503: 00000100:00100000:0.0:1789120828.179643:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.179958:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.180028:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970558848 00000100:00100000:2.0:1789120828.180033:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970558848 00000100:00100000:3.0:1789120828.180084:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789120828.180093:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970558848:12345-0@lo:503: 00000100:00100000:3.0:1789120828.180209:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970558848:12345-0@lo:503: Request processed in 117us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120828.180230:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789120828.180355:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970558848:0@lo:503: 00000100:00100000:0.0:1789120828.182261:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10353:1876028970558976:0@lo:502: 00000100:00100000:0.0:1789120828.182344:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.182436:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.182546:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970558976 00000100:00100000:2.0:1789120828.182552:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970558976 00000100:00100000:2.0:1789120828.182636:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1789120828.182647:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:10353:x1876028970558976:12345-0@lo:502: 00000100:00100000:2.0:1789120828.182899:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:10353:x1876028970558976:12345-0@lo:502: Request processed in 253us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.182907:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1789120828.183120:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10353:1876028970558976:0@lo:502: 00000100:00100000:0.0:1789120828.183162:0:10353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10353:1876028970559104:0@lo:502: 00000100:00100000:0.0:1789120828.183305:0:10353:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.183378:0:10353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.183458:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970559104 00000100:00100000:2.0:1789120828.183462:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970559104 00000100:00100000:2.0:1789120828.183600:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789120828.183608:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:10353:x1876028970559104:12345-0@lo:502: 00000100:00100000:2.0:1789120828.183681:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:10353:x1876028970559104:12345-0@lo:502: Request processed in 74us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.183687:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789120828.183849:0:10353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10353:1876028970559104:0@lo:502: 00000040:00080000:0.0:1789120828.183869:0:10353:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1789120828.184029:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:3.0:1789120828.184061:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789120828.184071:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.184082:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120828.184092:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789120828.184095:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789120828.184097:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789120828.184132:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.184140:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.184148:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120828.184163:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970559232:0@lo:101: 00000100:00100000:3.0:1789120828.184204:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.184234:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.184403:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970559232 00000100:00100000:2.0:1789120828.184408:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970559232 00000100:00100000:2.0:1789120828.184440:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1789120828.184448:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+16:6515:x1876028970559232:12345-0@lo:101: 00010000:00010000:2.0:1789120828.184458:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120828.184471:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1c00/0xb74d2367a830f365 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f35e expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.184502:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1c00/0xb74d2367a830f365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f35e expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.184512:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1c00/0xb74d2367a830f365 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f35e expref: 17 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.184520:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1c00, rc 0) 00000100:00100000:2.0:1789120828.184571:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970559232:12345-0@lo:101: Request processed in 125us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.184578:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789120828.184712:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970559232:0@lo:101: 00010000:00010000:0.0:1789120828.184725:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.184754:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120828.184804:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970559360:0@lo:501: 00000100:00100000:0.0:1789120828.184876:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.184895:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.185068:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970559360 00000100:00100000:2.0:1789120828.185072:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970559360 00000100:00100000:2.0:1789120828.185090:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789120828.185097:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970559360:12345-0@lo:501: 00000100:00100000:2.0:1789120828.185238:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970559360:12345-0@lo:501: Request processed in 140us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.185244:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789120828.185389:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970559360:0@lo:501: 00000100:00100000:0.0:1789120828.185417:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970559488:0@lo:503: 00000100:00100000:0.0:1789120828.185457:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.185486:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.185680:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970559488 00000100:00100000:2.0:1789120828.185685:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970559488 00000100:00100000:2.0:1789120828.185703:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1789120828.185709:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970559488:12345-0@lo:503: 00000100:00100000:2.0:1789120828.185894:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970559488:12345-0@lo:503: Request processed in 184us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.185901:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:0.0:1789120828.186043:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970559488:0@lo:503: 00000100:00100000:2.0:1789120828.186674:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10354:1876028970559616:0@lo:502: 00000100:00100000:2.0:1789120828.186716:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120828.186812:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19840 going to sleep for 11 seconds 00000100:00100000:0.0:1789120828.186879:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970559616 00000100:00100000:0.0:1789120828.186883:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970559616 00000100:00100000:0.0:1789120828.186915:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:0.0:1789120828.186921:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:10354:x1876028970559616:12345-0@lo:502: 00000100:00100000:0.0:1789120828.187114:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:10354:x1876028970559616:12345-0@lo:502: Request processed in 183us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120828.187122:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789120828.192325:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10354:1876028970559616:0@lo:502: 00000020:01000000:2.0:1789120828.192407:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120828.192421:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120828.192424:0:10354:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789120828.192430:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789120828.192472:0:10354:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10354:1876028970559744:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120828.193009:0:10354:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120828.193130:0:10354:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19840 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.194454:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970559744 00000100:00100000:1.0:1789120828.194466:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970559744 00000100:00100000:1.0:1789120828.194610:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789120828.194620:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+17:10354:x1876028970559744:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120828.194998:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+17:10354:x1876028970559744:12345-0@lo:502:llog_process_th.0 Request processed in 379us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.195006:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:2.0:1789120828.195380:0:10354:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10354:1876028970559744:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120828.195410:0:10354:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120828.195417:0:10354:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120828.195419:0:10354:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789120828.195423:0:10354:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:0.0:1789120828.195663:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1789120828.195685:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789120828.195695:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.195706:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120828.195730:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789120828.195733:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9468b9991000 from 48 10000000:01000000:0.0:1789120828.195735:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789120828.195992:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.196001:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.196010:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120828.196029:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970559872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120828.196577:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.196647:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99df00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.196855:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970559872 00000100:00100000:2.0:1789120828.196862:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970559872 00000100:00100000:2.0:1789120828.196994:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789120828.197003:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+17:6515:x1876028970559872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120828.197015:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120828.197030:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0200/0xb74d2367a830f373 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f36c expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.197065:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0200/0xb74d2367a830f373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f36c expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.197076:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0200/0xb74d2367a830f373 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f36c expref: 18 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.197084:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0200, rc 0) 00000100:00100000:2.0:1789120828.197148:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970559872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.197155:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789120828.197232:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcfc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970559872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120828.197248:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.197257:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120828.197343:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970560000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120828.197374:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.198010:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.198266:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970560000 00000100:00100000:1.0:1789120828.198273:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970560000 00000100:00100000:1.0:1789120828.198307:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789120828.198314:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970560000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.198578:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970560000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (1201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.198587:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:3.0:1789120828.198719:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970560000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120828.198937:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970560128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120828.198983:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.198997:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.199061:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970560128 00000100:00100000:1.0:1789120828.199066:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970560128 00000100:00100000:1.0:1789120828.199363:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:1.0:1789120828.199372:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970560128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.199470:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970560128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.199495:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789120828.199627:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970560128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120828.199898:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10355:1876028970560256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120828.199935:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.208589:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a05090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120828.209146:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970560256 00000100:00100000:0.0:1789120828.209159:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970560256 00000100:00100000:0.0:1789120828.209229:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789120828.209238:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:10355:x1876028970560256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120828.209427:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:10355:x1876028970560256:12345-0@lo:502:llog_process_th.0 Request processed in 189us (9490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120828.209435:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1789120828.209733:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10355:1876028970560256:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120828.209808:0:10355:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10355:1876028970560384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120828.209883:0:10355:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.209913:0:10355:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a05090c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120828.210036:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970560384 00000100:00100000:0.0:1789120828.210040:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970560384 00000100:00100000:0.0:1789120828.210075:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:0.0:1789120828.210083:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:10355:x1876028970560384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120828.210162:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:10355:x1876028970560384:12345-0@lo:502:llog_process_th.0 Request processed in 80us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120828.210176:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1789120828.210352:0:10355:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10355:1876028970560384:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789120828.210371:0:10355:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789120828.210598:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789120828.210620:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789120828.210628:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.210639:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120828.210648:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789120828.210651:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789120828.210654:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789120828.210679:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.210686:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.210695:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120828.210709:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970560512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120828.210751:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.210781:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99db40 going to sleep for 11 seconds 00000100:00100000:3.0:1789120828.210901:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970560512 00000100:00100000:3.0:1789120828.210906:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970560512 00000100:00100000:3.0:1789120828.210928:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1789120828.210934:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+18:6515:x1876028970560512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120828.210943:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120828.210961:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887082400/0xb74d2367a830f381 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f37a expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.210992:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887082400/0xb74d2367a830f381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f37a expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.211003:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887082400/0xb74d2367a830f381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f37a expref: 19 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.211011:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082400, rc 0) 00000100:00100000:3.0:1789120828.211045:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970560512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120828.211061:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1789120828.211229:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970560512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120828.211242:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.211262:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120828.211314:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970560640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120828.211350:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.211388:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.211452:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970560640 00000100:00100000:1.0:1789120828.211456:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970560640 00000100:00100000:1.0:1789120828.211555:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789120828.211563:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970560640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.211675:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970560640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 113us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.211682:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1789120828.211763:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970560640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120828.211790:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970560768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120828.211856:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.211874:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99db40 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.211989:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970560768 00000100:00100000:1.0:1789120828.211993:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970560768 00000100:00100000:1.0:1789120828.212012:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789120828.212018:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970560768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.212097:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970560768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.212103:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1789120828.212579:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970560768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120828.213982:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10356:1876028970560896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120828.214065:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.214139:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d840 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.214179:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970560896 00000100:00100000:1.0:1789120828.214184:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970560896 00000100:00100000:1.0:1789120828.214253:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789120828.214263:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+19:10356:x1876028970560896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120828.214390:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+19:10356:x1876028970560896:12345-0@lo:502:llog_process_th.0 Request processed in 129us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.214398:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1789120828.214471:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10356:1876028970560896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789120828.214509:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120828.214518:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120828.214520:0:10356:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789120828.214525:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789120828.214547:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10356:1876028970561024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120828.214578:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.214739:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d840 going to sleep for 11 seconds 00000100:00100000:3.0:1789120828.214971:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970561024 00000100:00100000:3.0:1789120828.214976:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970561024 00000100:00100000:3.0:1789120828.214998:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789120828.215004:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+19:10356:x1876028970561024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120828.215092:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+19:10356:x1876028970561024:12345-0@lo:502:llog_process_th.0 Request processed in 87us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120828.215098:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1789120828.215175:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10356:1876028970561024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789120828.215202:0:10356:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120828.215206:0:10356:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120828.215207:0:10356:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789120828.215211:0:10356:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:3.0:1789120828.215369:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789120828.215389:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789120828.215398:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.215408:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120828.215417:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789120828.215425:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946883582800 from 48 10000000:01000000:3.0:1789120828.215428:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789120828.215453:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.215460:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.215468:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120828.215549:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970561152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789120828.215583:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.215647:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509300 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.215679:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970561152 00000100:00100000:1.0:1789120828.215684:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970561152 00000100:00100000:2.0:1789120828.215725:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789120828.215735:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+19:6515:x1876028970561152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120828.215754:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120828.215768:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0800/0xb74d2367a830f38f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f388 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.215797:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0800/0xb74d2367a830f38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f388 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.215806:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0800/0xb74d2367a830f38f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f388 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.215815:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0800, rc 0) 00000100:00100000:2.0:1789120828.215876:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970561152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.215882:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789120828.215948:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970561152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120828.215960:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120828.215968:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120828.216016:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970561280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120828.216041:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.216291:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509300 going to sleep for 11 seconds 00000100:00100000:0.0:1789120828.216352:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970561280 00000100:00100000:0.0:1789120828.216356:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970561280 00000100:00100000:0.0:1789120828.216378:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1789120828.216384:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970561280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120828.216502:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970561280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120828.216508:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789120828.216626:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970561280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120828.216654:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970561408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120828.216689:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.216711:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509300 going to sleep for 11 seconds 00000100:00100000:0.0:1789120828.216812:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970561408 00000100:00100000:0.0:1789120828.216816:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970561408 00000100:00100000:0.0:1789120828.216859:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1789120828.216865:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970561408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120828.216936:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970561408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120828.216943:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789120828.217015:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970561408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120828.217381:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10357:1876028970561536:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120828.217417:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.217442:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120828.217543:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970561536 00000100:00100000:0.0:1789120828.217548:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970561536 00000100:00100000:0.0:1789120828.217578:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789120828.217585:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:10357:x1876028970561536:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120828.219719:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:10357:x1876028970561536:12345-0@lo:502:llog_process_th.0 Request processed in 2127us (2294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120828.219731:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789120828.219923:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10357:1876028970561536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120828.219984:0:10357:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10357:1876028970561664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120828.220030:0:10357:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120828.220063:0:10357:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789120828.220324:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970561664 00000100:00100000:0.0:1789120828.220340:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970561664 00000100:00100000:0.0:1789120828.220395:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1789120828.220403:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:10357:x1876028970561664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120828.220631:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:10357:x1876028970561664:12345-0@lo:502:llog_process_th.0 Request processed in 228us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120828.220637:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789120828.220705:0:10357:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10357:1876028970561664:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789120828.220726:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1789120828.221176:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1789120828.221201:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789120828.221211:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.221223:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120828.221234:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789120828.221236:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1789120828.221240:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789120828.221269:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.221276:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.221283:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120828.221299:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970561792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120828.221347:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.221384:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d180 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.222095:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970561792 00000100:00100000:1.0:1789120828.222103:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970561792 00000100:00100000:1.0:1789120828.222158:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:1.0:1789120828.222167:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970561792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120828.222178:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120828.222192:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f39d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f396 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.222214:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f396 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.222224:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f39d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f396 expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.222233:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3800, rc 0) 00000100:00100000:1.0:1789120828.222287:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970561792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.222294:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789120828.222386:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970561792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120828.222403:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.222411:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120828.222473:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970561920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120828.222521:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120828.222553:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.222660:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970561920 00000100:00100000:1.0:1789120828.222665:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970561920 00000100:00100000:1.0:1789120828.222695:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789120828.222701:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970561920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.222842:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970561920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 116us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.222849:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1789120828.223136:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970561920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120828.223166:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970562048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120828.223415:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120828.223442:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.223456:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970562048 00000100:00100000:2.0:1789120828.223460:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970562048 00000100:00100000:2.0:1789120828.223612:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789120828.223621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970562048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120828.223717:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970562048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.223724:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1789120828.223851:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970562048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.224089:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10358:1876028970562176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120828.224126:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120828.224146:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970562176 00000100:00100000:1.0:1789120828.224155:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970562176 00000100:00100000:1.0:1789120828.224175:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789120828.224181:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:10358:x1876028970562176:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120828.224259:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:10358:x1876028970562176:12345-0@lo:502:llog_process_th.0 Request processed in 78us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.224265:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789120828.224296:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.224306:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10358:1876028970562176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120828.224325:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120828.224342:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120828.224345:0:10358:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789120828.224350:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789120828.224367:0:10358:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10358:1876028970562304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120828.224394:0:10358:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120828.224410:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970562304 00000100:00100000:1.0:1789120828.224413:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970562304 00000100:00100000:1.0:1789120828.224427:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789120828.224432:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:10358:x1876028970562304:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120828.224670:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:10358:x1876028970562304:12345-0@lo:502:llog_process_th.0 Request processed in 236us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.224676:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1789120828.224703:0:10358:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835da480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.224714:0:10358:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10358:1876028970562304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120828.224730:0:10358:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120828.224733:0:10358:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120828.224735:0:10358:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789120828.224739:0:10358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1789120828.224805:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1789120828.224850:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789120828.224859:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.224868:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120828.224876:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789120828.224879:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946886899000 from 48 10000000:01000000:1.0:1789120828.224881:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789120828.224914:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.224922:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.224930:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120828.224942:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970562432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.224968:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120828.224981:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835da480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.224992:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970562432 00000100:00100000:1.0:1789120828.224995:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970562432 00000100:00100000:1.0:1789120828.225011:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789120828.225016:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970562432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120828.225024:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120828.225036:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a2400/0xb74d2367a830f3ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f3a4 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.225068:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a2400/0xb74d2367a830f3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f3a4 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.225079:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a2400/0xb74d2367a830f3ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f3a4 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.225087:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2400, rc 0) 00000100:00100000:1.0:1789120828.225118:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970562432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.225124:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789120828.225153:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970562432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120828.225165:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.225174:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120828.225396:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970562560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.225422:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120828.225435:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835da480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.225445:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970562560 00000100:00100000:1.0:1789120828.225448:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970562560 00000100:00100000:1.0:1789120828.225465:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1789120828.225470:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970562560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.226246:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970562560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 772us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.226265:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1789120828.235350:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970562560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120828.235427:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970562688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120828.235525:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120828.235576:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.235714:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970562688 00000100:00100000:1.0:1789120828.235720:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970562688 00000100:00100000:1.0:1789120828.235795:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789120828.235804:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970562688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.235945:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970562688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.235953:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789120828.236052:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970562688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120828.236433:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10359:1876028970562816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120828.236467:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.236501:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.236593:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970562816 00000100:00100000:1.0:1789120828.236597:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970562816 00000100:00100000:1.0:1789120828.236629:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789120828.236636:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:10359:x1876028970562816:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120828.236716:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:10359:x1876028970562816:12345-0@lo:502:llog_process_th.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.236722:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1789120828.236867:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10359:1876028970562816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120828.236902:0:10359:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10359:1876028970562944:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120828.236932:0:10359:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.236952:0:10359:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.236999:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970562944 00000100:00100000:1.0:1789120828.237003:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970562944 00000100:00100000:1.0:1789120828.237032:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1789120828.237039:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:10359:x1876028970562944:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120828.237099:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:10359:x1876028970562944:12345-0@lo:502:llog_process_th.0 Request processed in 60us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.237105:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789120828.237337:0:10359:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10359:1876028970562944:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789120828.237355:0:10359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1789120828.239079:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1789120828.239113:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789120828.239123:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.239149:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120828.239159:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789120828.239162:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1789120828.239165:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789120828.239210:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.239218:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.239228:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120828.239249:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970563072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.239311:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120828.239350:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa421540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.239865:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970563072 00000100:00100000:2.0:1789120828.239873:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970563072 00000100:00100000:2.0:1789120828.239923:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1789120828.239933:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970563072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120828.239945:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120828.239959:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1000/0xb74d2367a830f3b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f3b2 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.239994:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1000/0xb74d2367a830f3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f3b2 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.240004:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1000/0xb74d2367a830f3b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f3b2 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.240012:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1000, rc 0) 00000100:00100000:2.0:1789120828.240058:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970563072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.240065:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789120828.240617:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970563072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120828.240636:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.240644:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120828.240709:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970563200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.240756:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120828.240794:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa421540 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.240811:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970563200 00000100:00100000:1.0:1789120828.240816:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970563200 00000100:00100000:1.0:1789120828.240867:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789120828.240873:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970563200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.240980:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970563200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.240986:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789120828.241018:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970563200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.241062:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970563328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.241099:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120828.241113:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0f37a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120828.241123:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970563328 00000100:00100000:1.0:1789120828.241126:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970563328 00000100:00100000:1.0:1789120828.241143:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789120828.241148:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970563328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.241224:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970563328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.241230:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789120828.241266:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970563328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.242010:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10360:1876028970563456:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120828.242571:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120828.242652:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0f37d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.246393:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970563456 00000100:00100000:2.0:1789120828.246407:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970563456 00000100:00100000:2.0:1789120828.248065:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789120828.248078:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:10360:x1876028970563456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120828.248276:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:10360:x1876028970563456:12345-0@lo:502:llog_process_th.0 Request processed in 201us (5704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.248284:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789120828.248388:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10360:1876028970563456:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120828.248421:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789120828.248434:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120828.248436:0:10360:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789120828.248443:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789120828.248487:0:10360:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10360:1876028970563584:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120828.248530:0:10360:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120828.248567:0:10360:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa421540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.248707:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970563584 00000100:00100000:2.0:1789120828.248714:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970563584 00000100:00100000:2.0:1789120828.248756:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789120828.248763:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:10360:x1876028970563584:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120828.248856:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:10360:x1876028970563584:12345-0@lo:502:llog_process_th.0 Request processed in 93us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.248863:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789120828.249303:0:10360:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10360:1876028970563584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789120828.249344:0:10360:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789120828.249349:0:10360:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789120828.249351:0:10360:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789120828.249355:0:10360:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1789120828.249587:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:0.0:1789120828.249613:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789120828.249622:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.249632:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120828.249642:0:6515:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789120828.249645:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9468ab900000 from 1 10000000:01000000:0.0:1789120828.249647:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789120828.249675:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049200/0xb74d2367a830f3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.249683:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c2049200/0xb74d2367a830f3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120828.249691:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c2049200/0xb74d2367a830f3c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120828.249708:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970563712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120828.249757:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.249786:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99db40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.249970:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970563712 00000100:00100000:2.0:1789120828.249976:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970563712 00000100:00100000:2.0:1789120828.250023:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1789120828.250031:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970563712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120828.250054:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120828.250068:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0a00/0xb74d2367a830f3c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f3c0 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.250089:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0a00/0xb74d2367a830f3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f3c0 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.250099:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0a00/0xb74d2367a830f3c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f3c0 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120828.250108:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0a00, rc 0) 00000100:00100000:2.0:1789120828.250146:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970563712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.250152:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789120828.250951:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970563712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120828.250975:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c2049200/0xb74d2367a830f3c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.250986:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c2049200/0xb74d2367a830f3c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f3c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120828.251085:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970563840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120828.251134:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120828.251166:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0f37d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789120828.251707:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970563840 00000100:00100000:2.0:1789120828.251713:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970563840 00000100:00100000:2.0:1789120828.251768:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1789120828.251777:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970563840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120828.251898:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970563840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 121us (763us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789120828.251906:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789120828.253981:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970563840:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789120828.254036:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789120828.254058:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049200/0xb74d2367a830f3c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120828.254070:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c2049200/0xb74d2367a830f3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120828.367972:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120828.368020:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120828.369455:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120828.369503:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120828.369544:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120828.369642:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947436416 00000100:00100000:2.0:1789120828.369652:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947436416 00000100:00100000:2.0:1789120828.369715:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 242 00000100:00100000:2.0:1789120828.369725:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+8:2410:x1876028947436416:12345-192.168.202.32@tcp:400: 00000100:00100000:2.0:1789120828.369812:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+8:2410:x1876028947436416:12345-192.168.202.32@tcp:400: Request processed in 88us (1849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120828.369863:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 242 00000100:00100000:1.0:1789120828.370053:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947436928 00000100:00100000:1.0:1789120828.370058:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947436928 00000100:00100000:1.0:1789120828.370104:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947436800 00000100:00100000:1.0:1789120828.370107:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947436800 00000100:00100000:1.0:1789120828.370126:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:1.0:1789120828.370133:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947436928:12345-192.168.202.32@tcp:400: 00000100:00100000:1.0:1789120828.370170:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947436928:12345-192.168.202.32@tcp:400: Request processed in 38us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.370175:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:1.0:1789120828.370188:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:1.0:1789120828.370195:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947436800:12345-192.168.202.32@tcp:400: 00000100:00100000:1.0:1789120828.370218:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947436800:12345-192.168.202.32@tcp:400: Request processed in 24us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.370224:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00080000:2.0:1789120828.370337:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120828.370342:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120828.370662:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947436672 00000100:00100000:3.0:1789120828.370667:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947436672 00000100:00100000:3.0:1789120828.370717:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947436544 00000100:00100000:3.0:1789120828.370721:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947436544 00000100:00100000:3.0:1789120828.370742:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:3.0:1789120828.370750:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947436672:12345-192.168.202.32@tcp:400: 00000100:00100000:3.0:1789120828.370786:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947436672:12345-192.168.202.32@tcp:400: Request processed in 38us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120828.370793:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:3.0:1789120828.370810:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:3.0:1789120828.370847:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947436544:12345-192.168.202.32@tcp:400: 00000100:00100000:3.0:1789120828.370872:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bced00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947436544:12345-192.168.202.32@tcp:400: Request processed in 27us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120828.370878:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00080000:2.0:1789120828.370999:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120828.371003:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789120828.818332:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970563968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120828.818406:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.818479:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120828.818485:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970564096:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120828.818510:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.818601:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970563968 00000100:00100000:0.0:1789120828.818609:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970563968 00000100:00100000:0.0:1789120828.818660:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970564096 00000100:00100000:0.0:1789120828.818678:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970564096 00000100:00100000:0.0:1789120828.818700:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789120828.818714:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eaed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970563968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120828.818756:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120828.818808:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eaed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970563968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120828.818815:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789120828.818870:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789120828.818877:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970564096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120828.818892:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120828.818921:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970564096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 45us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120828.818927:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789120828.818945:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789120828.818949:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789120828.819271:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bccf00 x1876028970564096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120828.819290:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bccf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970564096:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789120828.819303:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b05a40 x1876028970563968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120828.819312:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970563968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120828.819499:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970564224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120828.819554:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.820080:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120828.820089:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970564352:0@lo:400:kworker.0 00000100:00100000:0.0:1789120828.820122:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.820155:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970564352 00000100:00100000:0.0:1789120828.820160:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970564352 00000100:00100000:0.0:1789120828.820278:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789120828.820287:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970564352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120828.820361:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970564352:12345-0@lo:400:kworker.0 Request processed in 75us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120828.820367:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789120828.820415:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970564352:0@lo:400:kworker.0 00000100:00100000:3.0:1789120828.820627:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970564864:0@lo:400:kworker.0 00000100:00100000:3.0:1789120828.820658:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.820685:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970565376:0@lo:400:kworker.0 00000100:00100000:3.0:1789120828.820712:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.820732:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789120828.820843:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970564608:0@lo:400:kworker.0 00000100:00100000:0.0:1789120828.820869:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.820887:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970565120:0@lo:400:kworker.0 00000100:00100000:0.0:1789120828.820907:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.820925:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789120828.820930:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970564480:0@lo:400:kworker.0 00000100:00100000:0.0:1789120828.821005:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.821021:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf663c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970564992:0@lo:400:kworker.0 00000100:00100000:0.0:1789120828.821054:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.821071:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970565504:0@lo:400:kworker.0 00000100:00100000:0.0:1789120828.821097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120828.821145:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970564864 00000100:00100000:0.0:1789120828.821149:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970564864 00000100:00100000:0.0:1789120828.821170:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970564608 00000100:00100000:0.0:1789120828.821172:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970564608 00000100:00100000:1.0:1789120828.821298:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970565376 00000100:00100000:1.0:1789120828.821302:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970565376 00000100:00100000:1.0:1789120828.821350:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970565120 00000100:00100000:1.0:1789120828.821353:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970565120 00000100:00100000:1.0:1789120828.821364:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970564480 00000100:00100000:1.0:1789120828.821366:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970564480 00000100:00100000:1.0:1789120828.821375:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970564992 00000100:00100000:1.0:1789120828.821377:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970564992 00000100:00100000:1.0:1789120828.821390:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789120828.821397:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970565376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120828.821435:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970565376:12345-0@lo:400:kworker.0 Request processed in 39us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.821451:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789120828.821465:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789120828.821472:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970565120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120828.821503:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970565120:12345-0@lo:400:kworker.0 Request processed in 32us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.821510:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789120828.821520:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789120828.821526:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970564480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120828.821552:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970564480:12345-0@lo:400:kworker.0 Request processed in 26us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.821558:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789120828.821569:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789120828.821574:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970564992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120828.821598:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970564992:12345-0@lo:400:kworker.0 Request processed in 25us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.821604:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1789120828.821621:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120828.821625:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789120828.821635:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970565504 00000100:00100000:1.0:1789120828.821638:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970565504 00000100:00100000:1.0:1789120828.821674:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789120828.821680:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970565504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120828.821720:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7483c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970565504:12345-0@lo:400:kworker.0 Request processed in 40us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120828.821726:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789120828.821840:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970564736:0@lo:400:kworker.0 00000100:00100000:3.0:1789120828.821869:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120828.821892:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970565248:0@lo:400:kworker.0 00000100:00100000:3.0:1789120828.821923:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789120828.821952:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf6630c0 x1876028970565376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120828.821964:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970565376:0@lo:400:kworker.0 00000100:00100000:3.0:1789120828.821987:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970564736 00000100:00100000:3.0:1789120828.821990:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970564736 00000100:00100000:3.0:1789120828.822007:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970565248 00000100:00100000:3.0:1789120828.822010:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970565248 00000100:00100000:3.0:1789120828.822024:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789120828.822030:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970564736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120828.822064:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970564736:12345-0@lo:400:kworker.0 Request processed in 34us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120828.822070:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789120828.822085:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789120828.822091:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970565248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120828.822117:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970565248:12345-0@lo:400:kworker.0 Request processed in 26us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120828.822122:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789120828.822150:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970564736:0@lo:400:kworker.0 00000100:00100000:3.0:1789120828.822159:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970565248:0@lo:400:kworker.0 00000100:00080000:3.0:1789120828.822893:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789120828.822898:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120828.822924:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970564480:0@lo:400:kworker.0 00000100:00100000:3.0:1789120828.822936:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf663c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970564992:0@lo:400:kworker.0 00010000:00080000:3.0:1789120828.822959:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf660f00 x1876028970565504/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120828.822969:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970565504:0@lo:400:kworker.0 00010000:00080000:3.0:1789120828.822992:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf662580 x1876028970565120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120844 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120828.823001:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970565120:0@lo:400:kworker.0 00000100:00100000:3.0:1789120828.823027:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970564224 00000100:00100000:3.0:1789120828.823031:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970564224 00000100:00100000:3.0:1789120828.823065:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789120828.823071:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970564224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120828.823087:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120828.823131:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bccf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970564224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (3578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120828.823138:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789120828.823234:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789120828.823244:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970564864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120828.823284:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970564864:12345-0@lo:400:kworker.0 Request processed in 43us (2625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120828.823344:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970564864:0@lo:400:kworker.0 00000100:00080000:1.0:1789120828.824745:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789120828.824802:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b90780 x1876028970564224/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120828.824858:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970564224:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120828.831009:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789120828.831070:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789120828.831088:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970564608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120828.831207:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970564608:12345-0@lo:400:kworker.0 Request processed in 128us (10335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120828.831232:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789120828.831746:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970564608:0@lo:400:kworker.0 00000100:00100000:2.0:1789120829.069268:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120829.071555:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947437056 00000100:00100000:0.0:1789120829.071571:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947437056 00000100:00100000:0.0:1789120829.071665:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 244 00000100:00100000:0.0:1789120829.071678:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+8:6186:x1876028947437056:12345-192.168.202.32@tcp:101: 00010000:00010000:0.0:1789120829.071698:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120829.071722:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c2048a00/0xb74d2367a830f3ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e8ea expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120829.071749:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c2048a00/0xb74d2367a830f3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8ea expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120829.071759:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c2048a00/0xb74d2367a830f3ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8ea expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120829.071767:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c2048a00, rc 0) 00000100:00100000:0.0:1789120829.071881:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6186:x1876028947437056:12345-192.168.202.32@tcp:101: Request processed in 204us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120829.071888:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 244 00000100:00100000:0.0:1789120829.078808:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120829.078972:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947437184 00000100:00100000:2.0:1789120829.078982:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947437184 00000100:00100000:2.0:1789120829.079035:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 245 00000100:00100000:2.0:1789120829.079044:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6186:x1876028947437184:12345-192.168.202.32@tcp:501: 00000100:00100000:2.0:1789120829.079186:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6186:x1876028947437184:12345-192.168.202.32@tcp:501: Request processed in 143us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120829.079194:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 245 00000100:00100000:1.0:1789120829.086088:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120829.086293:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947437312 00000100:00100000:2.0:1789120829.086303:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947437312 00000100:00100000:2.0:1789120829.086735:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 246 00000100:00100000:2.0:1789120829.086746:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6186:x1876028947437312:12345-192.168.202.32@tcp:503: 00000100:00100000:2.0:1789120829.086935:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6186:x1876028947437312:12345-192.168.202.32@tcp:503: Request processed in 190us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120829.086943:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 246 00000100:00100000:3.0:1789120829.090977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120829.101099:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947437440 00000100:00100000:0.0:1789120829.101112:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947437440 00000100:00100000:0.0:1789120829.101167:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 247 00000100:00100000:0.0:1789120829.101176:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6670:x1876028947437440:12345-192.168.202.32@tcp:502: 00000100:00100000:0.0:1789120829.101353:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6670:x1876028947437440:12345-192.168.202.32@tcp:502: Request processed in 176us (10384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120829.101361:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 247 00000100:00100000:3.0:1789120829.105015:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120829.105165:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947437568 00000100:00100000:0.0:1789120829.105176:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947437568 00000100:00100000:0.0:1789120829.105283:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 248 00000100:00100000:0.0:1789120829.105290:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6670:x1876028947437568:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120829.108544:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6670:x1876028947437568:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 3241us (3527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120829.108557:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 248 00000100:00100000:3.0:1789120829.117965:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120829.118120:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947437696 00000100:00100000:2.0:1789120829.118133:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947437696 00000100:00100000:2.0:1789120829.118200:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 249 00000100:00100000:2.0:1789120829.118211:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6186:x1876028947437696:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120829.118242:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120829.118265:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1400/0xb74d2367a830f3d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e8f1 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120829.118333:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1400/0xb74d2367a830f3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f1 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120829.118346:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1400/0xb74d2367a830f3d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f1 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120829.118356:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1400, rc 0) 00000100:00100000:2.0:1789120829.118436:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6186:x1876028947437696:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 225us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120829.118444:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 249 00000100:00100000:3.0:1789120829.120717:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120829.121108:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947437824 00000100:00100000:1.0:1789120829.121121:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947437824 00000100:00100000:1.0:1789120829.121233:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 250 00000100:00100000:1.0:1789120829.121246:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6186:x1876028947437824:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120829.121475:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6186:x1876028947437824:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 222us (766us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789120829.121486:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 250 00010000:00010000:3.0:1789120829.138127:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120829.330415:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970565632:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789120829.330535:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120829.330919:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970565632 00000100:00100000:0.0:1789120829.330932:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970565632 00000100:00100000:0.0:1789120829.331009:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789120829.331021:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970565632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120829.331051:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120829.331131:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970565632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 112us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120829.331140:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789120829.331242:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf748b40 x1876028970565632/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120829.331268:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970565632:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789120830.162951:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789120830.627430:0:10397:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda79f7560 20000000:00000080:0.0:1789120830.627519:0:10397:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9468840f5c00 uarg=0000000000000000 20000000:01000000:0.0:1789120830.627649:0:10397:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789120830.627657:0:10397:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789120830.627663:0:10397:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789120830.628765:0:10398:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1789120830.629161:0:10397:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1789120830.634155:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1789120830.634198:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1789120830.634217:0:10397:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1789120830.634237:0:10397:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789120830.634262:0:10397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.634285:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946887082800/0xb74d2367a830f078 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f071 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.634323:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a54000/0xb74d2367a830f086 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f07f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.634330:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f0da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f0d3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.634337:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468c2049e00/0xb74d2367a830f200 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f1f9 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.634348:0:10397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a3a00/0xb74d2367a830f318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8b2 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.634357:0:10397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.634414:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a3a00/0xb74d2367a830f318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8b2 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.634437:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468b99a3a00/0xb74d2367a830f318 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8b2 expref: 9 pid: 6513 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120830.634456:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876028970565760:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120830.635051:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468c2049e00/0xb74d2367a830f200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f1f9 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.635064:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468c2049e00/0xb74d2367a830f200 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f1f9 expref: 23 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120830.635074:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876028970565888:0@lo:104: 00000100:00100000:0.0:1789120830.635143:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789120830.635188:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f0da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f0d3 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.635197:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f0da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f0d3 expref: 23 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120830.635206:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876028970566016:0@lo:104: 00000100:00100000:2.0:1789120830.635386:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970565888 00000100:00100000:2.0:1789120830.635396:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970565888 00000100:00100000:2.0:1789120830.635458:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789120830.635468:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:10397:x1876028970565888:12345-0@lo:104: 00010000:00010000:2.0:1789120830.635484:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.635542:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120830.635549:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:10397:x1876028970565888:12345-0@lo:104: Request processed in 82us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120830.635556:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00010000:2.0:1789120830.635587:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120830.635593:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.635607:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f10200 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120830.635612:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.635620:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120830.635627:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120830.635632:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120830.635666:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.635672:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120830.635695:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.635702:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468a2f10200/0xb74d2367a830f1f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f200 expref: -99 pid: 9514 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.635717:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120830.635719:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120830.635721:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120830.635733:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf663840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970566144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120830.635765:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120830.635810:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120830.635863:0:6502:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1789120830.635867:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a54000/0xb74d2367a830f086 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f07f expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120830.635872:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970566016 00010000:00010000:0.0:1789120830.635876:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946899a54000/0xb74d2367a830f086 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f07f expref: 23 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120830.635881:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970566016 00000100:00100000:2.0:1789120830.635903:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789120830.635910:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782af1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:10397:x1876028970566016:12345-0@lo:104: 00010000:00010000:2.0:1789120830.635917:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.635952:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120830.635957:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782af1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:10397:x1876028970566016:12345-0@lo:104: Request processed in 48us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120830.635963:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:2.0:1789120830.636005:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120830.636011:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120830.636011:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876028970566272:0@lo:104: 00010000:00010000:2.0:1789120830.636017:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946880031400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120830.636021:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.636028:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120830.636035:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120830.636035:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789120830.636041:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120830.636055:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.636056:0:10397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946887082800/0xb74d2367a830f078 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f071 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.636063:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789120830.636066:0:10397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946887082800/0xb74d2367a830f078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f071 expref: 23 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.636072:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120830.636074:0:10397:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876028970566400:0@lo:104: 00010000:00010000:2.0:1789120830.636084:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946880031400/0xb74d2367a830f0d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f0da expref: -99 pid: 8426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120830.636092:0:10397:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120830.636094:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120830.636096:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120830.636097:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120830.636101:0:10397:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468904436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120830.636106:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970566528:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120830.636123:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74b840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876028970565888:0@lo:104: 00000100:00100000:2.0:1789120830.636128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120830.636132:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876028970566016:0@lo:104: 00000100:00100000:2.0:1789120830.636156:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970566144 00000100:00100000:2.0:1789120830.636160:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970566144 00010000:00010000:2.0:1789120830.636179:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468c2049e00/0xb74d2367a830f200 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f1f9 expref: 24 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120830.636206:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970566528 00000100:00100000:2.0:1789120830.636209:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970566528 00010000:00010000:2.0:1789120830.636221:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f0da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f0d3 expref: 25 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120830.636662:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789120830.636676:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf662d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+25:3644:x1876028970566144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120830.636690:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120830.636697:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468c2049e00/0xb74d2367a830f200 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f1f9 expref: 25 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.636708:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468c2049e00/0xb74d2367a830f200 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f1f9 expref: 25 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.636723:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c2049e00/0xb74d2367a830f200 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f1f9 expref: 25 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.636738:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120830.636771:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf662d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970566144:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120830.636789:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789120830.636804:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789120830.636810:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+23:3645:x1876028970566528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120830.636817:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120830.636852:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f0da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f0d3 expref: 23 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.636860:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f0da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f0d3 expref: 23 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.636871:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f0da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f0d3 expref: 23 pid: 6513 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.636880:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120830.636917:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+22:3645:x1876028970566528:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120830.636924:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789120830.637064:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6603c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970566528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120830.637469:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970566272 00000100:00100000:2.0:1789120830.637475:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970566272 00000100:00100000:2.0:1789120830.637498:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970566400 00000100:00100000:2.0:1789120830.637501:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970566400 00000100:00100000:2.0:1789120830.637516:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789120830.637522:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:10397:x1876028970566272:12345-0@lo:104: 00010000:00010000:2.0:1789120830.637531:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.637582:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120830.637587:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:10397:x1876028970566272:12345-0@lo:104: Request processed in 66us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120830.637602:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789120830.637615:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789120830.637620:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:10397:x1876028970566400:12345-0@lo:104: 00010000:00010000:2.0:1789120830.637629:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a830f071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.637645:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120830.637652:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.637659:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946880031000 already unused, calling callback (ffffffffc130ac20) 00010000:00010000:2.0:1789120830.637662:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:1.0:1789120830.637662:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120830.637667:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:10397:x1876028970566400:12345-0@lo:104: Request processed in 47us (1574us total) trans 0 rc 0/0 00010000:00010000:1.0:1789120830.637671:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120830.637672:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 10000000:00010000:1.0:1789120830.637679:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.637685:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120830.637690:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a830f071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120830.637692:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120830.637696:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120830.637699:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a830f071 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.637706:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a830f071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120830.637711:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a830f071 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120830.637716:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789120830.637719:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.637725:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120830.637727:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a830f071 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.637732:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120830.637745:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.637757:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946880031000/0xb74d2367a830f07f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f086 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.637770:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120830.637772:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120830.637773:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120830.637785:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970566656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120830.637863:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120830.637969:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120830.637977:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970566784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120830.638010:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120830.638041:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970566656 00000100:00100000:1.0:1789120830.638044:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970566656 00010000:00010000:1.0:1789120830.638064:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a54000/0xb74d2367a830f086 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f07f expref: 22 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120830.638083:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970566784 00000100:00100000:1.0:1789120830.638087:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970566784 00010000:00010000:1.0:1789120830.638099:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946887082800/0xb74d2367a830f078 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f071 expref: 23 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120830.638129:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789120830.638135:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b91a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+23:3646:x1876028970566656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120830.638145:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120830.638150:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a54000/0xb74d2367a830f086 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f07f expref: 23 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.638159:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a54000/0xb74d2367a830f086 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f07f expref: 23 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.638175:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120830.638202:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b91a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:03a1864a-46e4-4762-8a00-3ced97b06903+23:3646:x1876028970566656:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120830.638208:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789120830.638220:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789120830.638238:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+22:3646:x1876028970566784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120830.638246:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789120830.638257:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970566656:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120830.638261:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946887082800/0xb74d2367a830f078 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f071 expref: 22 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120830.638270:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946887082800/0xb74d2367a830f078 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f071 expref: 22 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120830.638281:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120830.638326:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835ed850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+22:3646:x1876028970566784:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120830.638333:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789120830.638479:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970566784:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120830.638792:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a54000/0xb74d2367a830f086 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f07f expref: 21 pid: 6510 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120830.638812:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876028970566272:0@lo:104: 00010000:00010000:0.0:1789120830.638930:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887082800/0xb74d2367a830f078 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f071 expref: 20 pid: 6512 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120830.638941:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876028970566400:0@lo:104: 00010000:00010000:2.0:1789120830.639986:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a830f071 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.640001:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a830f071 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f078 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120830.640026:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120830.640028:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120830.640031:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120830.642164:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf663840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970566144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120830.644588:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120830.644664:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947437952 00000100:00100000:1.0:1789120830.644673:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947437952 00000100:00100000:0.0:1789120830.644681:0:10397:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10397:1876028970565760:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120830.644723:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a3a00/0xb74d2367a830f318 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8b2 expref: 10 pid: 6513 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.644725:0:10397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120830.645016:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:1.0:1789120830.645029:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf662580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2411:x1876028947437952:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120830.645049:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120830.645057:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a3a00/0xb74d2367a830f318 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8b2 expref: 10 pid: 6513 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645086:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a3a00/0xb74d2367a830f318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8b2 expref: 10 pid: 6513 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645111:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3a00/0xb74d2367a830f318 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8b2 expref: 10 pid: 6513 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645131:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645141:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645157:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645164:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645172:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645179:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645186:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789120830.645190:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645198:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645292:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120830.645303:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120830.645417:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf662580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+9:2411:x1876028947437952:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 390us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120830.645426:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00010000:00010000:0.0:1789120830.645492:0:10397:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.645500:0:10397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120830.645506:0:10397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217d400/0xb74d2367a830f3dc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120831.002978:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120831.003151:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947438080 00000100:00100000:2.0:1789120831.003164:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947438080 00000100:00100000:2.0:1789120831.003247:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 251 00000100:00100000:2.0:1789120831.003259:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+9:6186:x1876028947438080:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120831.003284:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120831.003322:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f3e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e8f8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120831.003360:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f3e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f8 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120831.003373:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f3e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f8 expref: 10 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120831.003385:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0e00, rc 0) 00000100:00100000:2.0:1789120831.003469:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6186:x1876028947438080:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 212us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120831.003477:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 251 00000100:00100000:2.0:1789120831.019230:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120831.019373:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947438208 00000100:00100000:1.0:1789120831.019384:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947438208 00000100:00100000:1.0:1789120831.019464:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 252 00000100:00100000:1.0:1789120831.019476:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6186:x1876028947438208:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120831.019693:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6186:x1876028947438208:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 218us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120831.019711:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 252 00000100:00100000:3.0:1789120831.027109:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120831.027390:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947438336 00000100:00100000:0.0:1789120831.027405:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947438336 00000100:00100000:0.0:1789120831.027486:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 253 00000100:00100000:0.0:1789120831.027498:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6186:x1876028947438336:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120831.027693:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6186:x1876028947438336:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 196us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120831.027709:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 253 00000100:00100000:3.0:1789120831.030380:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120831.030960:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947438464 00000100:00100000:2.0:1789120831.030974:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947438464 00000100:00100000:2.0:1789120831.031052:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 254 00000100:00100000:2.0:1789120831.031064:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6727:x1876028947438464:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789120831.034704:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6727:x1876028947438464:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 1754us (2452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120831.034731:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 254 00000100:00100000:2.0:1789120831.039578:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120831.039718:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947438592 00000100:00100000:1.0:1789120831.039731:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947438592 00000100:00100000:1.0:1789120831.039815:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 255 00000100:00100000:1.0:1789120831.039988:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6727:x1876028947438592:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789120831.040531:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:6727:x1876028947438592:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 544us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120831.040541:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 255 00010000:00010000:2.0:1789120831.186032:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120831.893809:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970566912:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120831.893905:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120831.894009:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120831.894017:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970567040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120831.894051:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120831.894274:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970566912 00000100:00100000:2.0:1789120831.894282:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970566912 00000100:00100000:2.0:1789120831.894333:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970567040 00000100:00100000:2.0:1789120831.894336:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970567040 00000100:00100000:2.0:1789120831.894634:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789120831.894647:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970566912:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789120831.894689:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789120831.894753:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970566912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (847us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120831.894761:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789120831.894780:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789120831.894788:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970567040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789120831.894817:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120831.894876:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970567040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120831.894883:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789120831.894958:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970567040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120831.894989:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970566912:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789120832.214375:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789120832.337959:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789120832.337970:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946782aee800 from 4 10000000:01000000:1.0:1789120832.337976:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789120832.338105:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120832.338118:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120832.338130:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120832.338162:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970567168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120832.338241:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120832.338319:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970567168 00000100:00100000:0.0:1789120832.338335:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970567168 00000100:00100000:1.0:1789120832.338409:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa421540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120832.338419:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1789120832.338436:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970567168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120832.338460:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120832.338484:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f3f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f3ea expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.338522:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f3f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f3ea expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.338537:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f3f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f3ea expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.338548:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217cc00, rc 0) 00000100:00100000:0.0:1789120832.338654:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970567168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 215us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.338664:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789120832.338693:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b912c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970567168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120832.338722:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120832.338735:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120832.339013:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970567296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.339052:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120832.339091:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120832.339146:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970567296 00000100:00100000:1.0:1789120832.339154:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970567296 00000100:00100000:1.0:1789120832.339210:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789120832.339219:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970567296:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120832.339519:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970567296:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 299us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120832.339547:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789120832.339561:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970567296:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.339607:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970567424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.339666:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120832.339690:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120832.339717:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970567424 00000100:00100000:1.0:1789120832.339723:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970567424 00000100:00100000:1.0:1789120832.339760:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789120832.339769:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970567424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.340101:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970567424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 331us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.340125:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1789120832.340144:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970567424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120832.342474:0:10471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b912c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10471:1876028970567552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120832.342587:0:10471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120832.342632:0:10471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468918caf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120832.342700:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970567552 00000100:00100000:2.0:1789120832.342709:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970567552 00000100:00100000:2.0:1789120832.342770:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789120832.342782:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:10471:x1876028970567552:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120832.342959:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:10471:x1876028970567552:12345-0@lo:502:llog_process_th.0 Request processed in 178us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120832.342967:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789120832.343085:0:10471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b912c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10471:1876028970567552:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120832.343121:0:10471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120832.343133:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120832.343135:0:10471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789120832.343142:0:10471:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946782aee800 00000020:00000080:3.0:1789120832.343145:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120832.343236:0:10471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10471:1876028970567680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120832.343272:0:10471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120832.343300:0:10471:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120832.343361:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970567680 00000100:00100000:1.0:1789120832.343365:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970567680 00000100:00100000:1.0:1789120832.343397:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789120832.343404:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:10471:x1876028970567680:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120832.343473:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:10471:x1876028970567680:12345-0@lo:502:llog_process_th.0 Request processed in 69us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120832.343480:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789120832.347623:0:10471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10471:1876028970567680:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120832.347707:0:10471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120832.347720:0:10471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120832.347723:0:10471:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789120832.347728:0:10471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1789120832.353412:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1789120832.353468:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789120832.353483:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120832.353499:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120832.353512:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789120832.353515:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468b9991000 from 4 10000000:01000000:3.0:1789120832.353519:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789120832.353573:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120832.353582:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120832.353595:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120832.353631:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970567808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789120832.353738:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120832.353811:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120832.353860:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970567808 00000100:00100000:3.0:1789120832.353868:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970567808 00000100:00100000:3.0:1789120832.353932:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789120832.353942:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970567808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120832.353986:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120832.354003:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887082800/0xb74d2367a830f3ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f3f8 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120832.354035:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887082800/0xb74d2367a830f3ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f3f8 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120832.354048:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887082800/0xb74d2367a830f3ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f3f8 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120832.354059:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082800, rc 0) 00000100:00100000:3.0:1789120832.354107:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970567808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120832.354115:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789120832.354176:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970567808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120832.354192:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120832.354202:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120832.354275:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970567936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120832.354317:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120832.354331:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120832.354343:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970567936 00000100:00100000:3.0:1789120832.354346:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970567936 00000100:00100000:3.0:1789120832.354367:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789120832.354373:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970567936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120832.354516:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970567936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120832.354524:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789120832.354554:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970567936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120832.354584:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970568064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120832.354629:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120832.354641:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120832.354652:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970568064 00000100:00100000:3.0:1789120832.354655:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970568064 00000100:00100000:3.0:1789120832.354674:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789120832.354680:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970568064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120832.354765:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970568064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120832.354772:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789120832.354813:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970568064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120832.355555:0:10473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10473:1876028970568192:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120832.355606:0:10473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120832.355631:0:10473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468918caf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120832.355999:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970568192 00000100:00100000:0.0:1789120832.356006:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970568192 00000100:00100000:0.0:1789120832.356069:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789120832.356078:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:10473:x1876028970568192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120832.356201:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:10473:x1876028970568192:12345-0@lo:502:llog_process_th.0 Request processed in 124us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.356210:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789120832.356338:0:10473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10473:1876028970568192:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120832.356372:0:10473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120832.356385:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120832.356388:0:10473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789120832.356396:0:10473:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9468b9991000 00000020:00000080:3.0:1789120832.356398:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120832.359206:0:10473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10473:1876028970568320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120832.359338:0:10473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120832.359391:0:10473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852cb840 going to sleep for 11 seconds 00000100:00100000:2.0:1789120832.365342:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970568320 00000100:00100000:2.0:1789120832.365362:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970568320 00000100:00100000:2.0:1789120832.365449:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789120832.365462:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:10473:x1876028970568320:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120832.370034:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:10473:x1876028970568320:12345-0@lo:502:llog_process_th.0 Request processed in 4559us (10682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120832.370056:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789120832.370983:0:10473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10473:1876028970568320:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120832.371041:0:10473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120832.371054:0:10473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120832.371057:0:10473:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1789120832.371063:0:10473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789120832.379672:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789120832.379731:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120832.379747:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.379763:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120832.379778:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789120832.379781:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946883582800 from 4 10000000:01000000:0.0:1789120832.379785:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120832.379873:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.379883:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.379898:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120832.379936:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970568448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.380058:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120832.380114:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19900 going to sleep for 11 seconds 00000100:00100000:0.0:1789120832.380142:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970568448 00000100:00100000:0.0:1789120832.380151:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970568448 00000100:00100000:0.0:1789120832.380212:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789120832.380223:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970568448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120832.380240:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120832.380255:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c217c000/0xb74d2367a830f40d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f406 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.380286:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217c000/0xb74d2367a830f40d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f406 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.380310:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c217c000/0xb74d2367a830f40d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f406 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.380322:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217c000, rc 0) 00000100:00100000:0.0:1789120832.380368:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970568448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.380376:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789120832.380433:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970568448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120832.380450:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.380460:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120832.380535:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970568576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.380575:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120832.380594:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19900 going to sleep for 11 seconds 00000100:00100000:0.0:1789120832.380609:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970568576 00000100:00100000:0.0:1789120832.380612:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970568576 00000100:00100000:0.0:1789120832.380637:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789120832.380644:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970568576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.380775:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970568576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 131us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.380782:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789120832.380813:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970568576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.380870:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970568704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.380915:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120832.380930:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19900 going to sleep for 11 seconds 00000100:00100000:0.0:1789120832.380943:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970568704 00000100:00100000:0.0:1789120832.380946:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970568704 00000100:00100000:0.0:1789120832.380969:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789120832.380975:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970568704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.381059:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970568704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.381066:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789120832.381107:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970568704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120832.387080:0:10475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10475:1876028970568832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120832.387216:0:10475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120832.387276:0:10475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120832.387371:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970568832 00000100:00100000:0.0:1789120832.387381:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970568832 00000100:00100000:0.0:1789120832.387447:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789120832.387459:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:10475:x1876028970568832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120832.387627:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:10475:x1876028970568832:12345-0@lo:502:llog_process_th.0 Request processed in 169us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.387637:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789120832.387717:0:10475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10475:1876028970568832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789120832.387754:0:10475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789120832.387768:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120832.387770:0:10475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789120832.387780:0:10475:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946883582800 00000020:00000080:0.0:1789120832.387783:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789120832.388336:0:10475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10475:1876028970568960:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120832.388392:0:10475:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120832.388422:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970568960 00000100:00100000:0.0:1789120832.388427:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970568960 00000100:00100000:0.0:1789120832.388457:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789120832.388464:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:10475:x1876028970568960:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120832.388550:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:10475:x1876028970568960:12345-0@lo:502:llog_process_th.0 Request processed in 86us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.388557:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789120832.388598:0:10475:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120832.388615:0:10475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10475:1876028970568960:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789120832.388637:0:10475:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789120832.388643:0:10475:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789120832.388645:0:10475:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789120832.388649:0:10475:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789120832.388725:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789120832.388751:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120832.388770:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.388783:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120832.388798:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789120832.388801:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946886899000 from 4 10000000:01000000:0.0:1789120832.388805:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120832.388868:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.388878:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.388890:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120832.388906:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970569088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.388938:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120832.388954:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120832.388966:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970569088 00000100:00100000:0.0:1789120832.388970:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970569088 00000100:00100000:0.0:1789120832.388994:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789120832.389000:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970569088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120832.389011:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120832.389027:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c217d200/0xb74d2367a830f41b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f414 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.389056:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217d200/0xb74d2367a830f41b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f414 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.389078:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c217d200/0xb74d2367a830f41b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f414 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.389089:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d200, rc 0) 00000100:00100000:0.0:1789120832.389120:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970569088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.389127:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1789120832.389161:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970569088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120832.389175:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.389185:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120832.389241:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970569216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.389268:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120832.389281:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120832.389304:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970569216 00000100:00100000:0.0:1789120832.389307:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970569216 00000100:00100000:0.0:1789120832.389329:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789120832.389335:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970569216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.389461:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970569216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.389467:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789120832.389498:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970569216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.389539:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970569344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.389578:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120832.389590:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b196c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120832.389600:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970569344 00000100:00100000:0.0:1789120832.389603:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970569344 00000100:00100000:0.0:1789120832.389622:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789120832.389628:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970569344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120832.389697:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970569344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.389704:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789120832.389741:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970569344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120832.398773:0:10476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10476:1876028970569472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120832.398965:0:10476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120832.399317:0:10476:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852cbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120832.403784:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970569472 00000100:00100000:0.0:1789120832.403803:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970569472 00000100:00100000:0.0:1789120832.403895:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1789120832.403907:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:10476:x1876028970569472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120832.404140:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:10476:x1876028970569472:12345-0@lo:502:llog_process_th.0 Request processed in 234us (5175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120832.404149:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789120832.407374:0:10476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10476:1876028970569472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120832.407443:0:10476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120832.407458:0:10476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120832.407460:0:10476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789120832.407469:0:10476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946886899000 00000020:00000080:3.0:1789120832.407472:0:10476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120832.407590:0:10476:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10476:1876028970569600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120832.407703:0:10476:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120832.407763:0:10476:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852cbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120832.407917:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970569600 00000100:00100000:3.0:1789120832.407925:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970569600 00000100:00100000:3.0:1789120832.407984:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789120832.407996:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:10476:x1876028970569600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120832.408146:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:10476:x1876028970569600:12345-0@lo:502:llog_process_th.0 Request processed in 151us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120832.408155:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1789120832.408207:0:10476:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b38000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:10476:1876028970569600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120832.408232:0:10476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120832.408237:0:10476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120832.408239:0:10476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789120832.408243:0:10476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789120832.409539:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789120832.409582:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120832.409597:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120832.409611:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120833.237366:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120833.486710:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120833.486814:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120833.486940:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120833.486974:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120833.487007:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120833.487063:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947438976 00000100:00100000:3.0:1789120833.487076:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947438976 00000100:00100000:3.0:1789120833.487151:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947438848 00000100:00100000:3.0:1789120833.487155:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947438848 00000100:00100000:3.0:1789120833.487180:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:3.0:1789120833.487192:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947438976:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120833.487223:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947439232 00000100:00100000:2.0:1789120833.487228:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947439232 00000100:00100000:2.0:1789120833.487259:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947439104 00000100:00100000:2.0:1789120833.487291:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947439104 00000100:00100000:2.0:1789120833.487316:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789120833.487318:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947438976:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 128us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120833.487324:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947439232:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120833.487326:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:3.0:1789120833.487348:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:3.0:1789120833.487355:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2409:x1876028947438848:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120833.487355:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947439232:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 32us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120833.487362:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:2.0:1789120833.487373:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789120833.487378:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2409:x1876028947438848:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120833.487379:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947439104:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120833.487384:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:2.0:1789120833.487401:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947439104:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 21us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120833.487407:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00080000:1.0:1789120833.487582:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120833.487588:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120833.487591:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120833.487593:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789120833.488115:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947438720 00000100:00100000:0.0:1789120833.488124:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947438720 00000100:00100000:0.0:1789120833.488181:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 276 00000100:00100000:0.0:1789120833.488189:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2409:x1876028947438720:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120833.488263:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2409:x1876028947438720:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 75us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.488271:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 276 00000100:00100000:1.0:1789120833.938079:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789120833.938115:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970569728:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120833.938217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120833.938323:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970569856:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789120833.938372:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120833.938526:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970570368:0@lo:400:kworker.0 00000100:00100000:2.0:1789120833.938582:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120833.938621:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970570880:0@lo:400:kworker.0 00000100:00100000:2.0:1789120833.938656:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120833.938658:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970570240:0@lo:400:kworker.0 00000100:00100000:2.0:1789120833.938683:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970571392:0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.938699:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120833.938715:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120833.938719:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970570752:0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.938741:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120833.938744:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1789120833.938750:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf663c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970569984:0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.938757:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970571264:0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.938779:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120833.938798:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789120833.938803:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970570112:0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.938846:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120833.938864:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970570624:0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.938888:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120833.938909:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970571136:0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.938934:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120833.938963:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970570368 00000100:00100000:0.0:1789120833.938972:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970570368 00000100:00100000:0.0:1789120833.939023:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970570752 00000100:00100000:0.0:1789120833.939026:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970570752 00000100:00100000:0.0:1789120833.939065:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970571264 00000100:00100000:0.0:1789120833.939068:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970571264 00000100:00100000:0.0:1789120833.939081:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970570112 00000100:00100000:0.0:1789120833.939084:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970570112 00000100:00100000:0.0:1789120833.939094:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970570624 00000100:00100000:0.0:1789120833.939096:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970570624 00000100:00100000:0.0:1789120833.939111:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970571136 00000100:00100000:0.0:1789120833.939113:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970571136 00000100:00100000:0.0:1789120833.939131:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789120833.939140:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970570368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.939200:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970570368:12345-0@lo:400:kworker.0 Request processed in 61us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.939208:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789120833.939228:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789120833.939234:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970570752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.939269:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970570752:12345-0@lo:400:kworker.0 Request processed in 35us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.939285:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789120833.939299:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789120833.939305:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970571264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.939334:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970571264:12345-0@lo:400:kworker.0 Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.939340:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789120833.939352:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789120833.939357:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970570112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120833.939362:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120833.939549:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970570496:0@lo:400:kworker.0 00000100:00100000:2.0:1789120833.939599:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120833.939629:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf663840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970571008:0@lo:400:kworker.0 00000100:00100000:2.0:1789120833.939660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120833.939706:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970571520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120833.939742:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120833.943173:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970570112:12345-0@lo:400:kworker.0 Request processed in 3800us (4310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.943219:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789120833.943263:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789120833.943287:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970570624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.943395:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970570624:12345-0@lo:400:kworker.0 Request processed in 124us (4505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.943402:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789120833.943415:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789120833.943423:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970571136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.943457:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970571136:12345-0@lo:400:kworker.0 Request processed in 34us (4521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.943463:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789120833.943503:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970569984 00000100:00100000:0.0:1789120833.943514:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970569984 00000100:00100000:0.0:1789120833.943584:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789120833.943592:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970569984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.943642:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970569984:12345-0@lo:400:kworker.0 Request processed in 52us (4279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.943649:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789120833.943765:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970570112:0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.943782:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970570624:0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.943795:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970571136:0@lo:400:kworker.0 00010000:00080000:0.0:1789120833.943813:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf661e00 x1876028970570752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120833.943860:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970570752:0@lo:400:kworker.0 00010000:00080000:0.0:1789120833.943876:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf660000 x1876028970571264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120833.943885:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970571264:0@lo:400:kworker.0 00000100:00080000:0.0:1789120833.944144:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120833.944151:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789120833.944193:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970570240 00000100:00100000:0.0:1789120833.944199:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970570240 00000100:00100000:0.0:1789120833.944222:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970570496 00000100:00100000:0.0:1789120833.944226:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970570496 00000100:00100000:0.0:1789120833.944240:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789120833.944247:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970570240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.944313:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970570240:12345-0@lo:400:kworker.0 Request processed in 66us (5613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.944320:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789120833.944334:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789120833.944340:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf6603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970570496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.944373:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf6603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970570496:12345-0@lo:400:kworker.0 Request processed in 34us (4773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.944389:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789120833.944608:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970570880 00000100:00100000:0.0:1789120833.944613:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970570880 00000100:00100000:0.0:1789120833.944771:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970571392 00000100:00100000:0.0:1789120833.944775:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970571392 00000100:00100000:0.0:1789120833.944791:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970571008 00000100:00100000:0.0:1789120833.944794:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970571008 00000100:00100000:0.0:1789120833.944858:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789120833.944866:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf662d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970570880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.944988:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf662d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970570880:12345-0@lo:400:kworker.0 Request processed in 123us (6331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.944996:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789120833.945009:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789120833.945015:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970571392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.945047:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970571392:12345-0@lo:400:kworker.0 Request processed in 33us (6331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.945054:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789120833.945064:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789120833.945070:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970571008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120833.945099:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970571008:12345-0@lo:400:kworker.0 Request processed in 30us (5446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120833.945105:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1789120833.945121:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120833.945125:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120833.945155:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970570240:0@lo:400:kworker.0 00000100:00100000:2.0:1789120833.948532:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970570368:0@lo:400:kworker.0 00010000:00080000:2.0:1789120833.948574:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf660f00 x1876028970570880/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120833.948586:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970570880:0@lo:400:kworker.0 00000100:00100000:3.0:1789120833.948603:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970569728 00010000:00080000:2.0:1789120833.948605:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf663480 x1876028970571392/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120833.948613:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970569728 00000100:00100000:2.0:1789120833.948613:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf663480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970571392:0@lo:400:kworker.0 00000100:00100000:2.0:1789120833.948649:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf663c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970569984:0@lo:400:kworker.0 00000100:00100000:2.0:1789120833.948666:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6630c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970570496:0@lo:400:kworker.0 00010000:00080000:2.0:1789120833.948679:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf663840 x1876028970571008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120849 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120833.948697:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf663840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970571008:0@lo:400:kworker.0 00000100:00100000:3.0:1789120833.948761:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970569856 00000100:00100000:3.0:1789120833.948765:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970569856 00000100:00100000:3.0:1789120833.948780:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970571520 00000100:00100000:3.0:1789120833.948783:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970571520 00000100:00100000:3.0:1789120833.948800:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789120833.948810:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970569728:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1789120833.948985:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789120833.949057:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120833.949398:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b921c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970569728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 588us (11180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120833.949409:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789120833.949436:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789120833.949444:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970569856:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120833.949469:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120833.949504:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970569856:12345-0@lo:13:osp-pre-0-1.0 Request processed in 62us (11131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120833.949511:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789120833.949524:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789120833.949531:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970571520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120833.949541:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120833.949580:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970571520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (9837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120833.949586:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1789120833.951599:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf748000 x1876028970571520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120833.951648:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970571520:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789120833.952561:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b3a1c0 x1876028970569728/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120833.952585:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970569728:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789120833.952603:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b92d00 x1876028970569856/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120833.952617:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970569856:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789120834.259381:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120834.450407:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120834.450762:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970571648:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789120834.450954:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120834.451161:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970571648 00000100:00100000:3.0:1789120834.451173:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970571648 00000100:00100000:3.0:1789120834.451255:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789120834.451267:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970571648:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789120834.451310:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120834.451393:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970571648:12345-0@lo:13:osp-pre-1-1.0 Request processed in 120us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120834.451402:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789120834.451778:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf748000 x1876028970571648/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120834.451810:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970571648:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789120835.283416:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120836.307005:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120837.010209:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970571776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120837.010333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120837.010443:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970571776 00000100:00100000:0.0:1789120837.010452:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970571776 00000100:00100000:0.0:1789120837.010520:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789120837.010530:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970571776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789120837.010579:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789120837.010633:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970571776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120837.010642:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789120837.010699:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970571776:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120837.016542:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120837.016575:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970571904:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789120837.016683:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120837.025459:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970571904 00000100:00100000:1.0:1789120837.025480:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970571904 00000100:00100000:1.0:1789120837.025560:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789120837.025573:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970571904:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789120837.025627:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789120837.025755:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970571904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 183us (9071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120837.025763:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789120837.027065:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b392c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970571904:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789120837.330412:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789120837.385381:0:10697:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1789120838.359875:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120838.605756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120838.605810:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120838.605927:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947439360 00000100:00100000:1.0:1789120838.605956:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947439360 00000100:00100000:1.0:1789120838.606023:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 278 00000100:00100000:1.0:1789120838.606036:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2410:x1876028947439360:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120838.606152:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2410:x1876028947439360:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 117us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120838.606160:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 278 00000100:00100000:0.0:1789120838.607098:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120838.607129:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120838.607158:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120838.607267:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947439616 00000100:00100000:0.0:1789120838.607275:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947439616 00000100:00100000:0.0:1789120838.607458:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947439488 00000100:00100000:0.0:1789120838.607462:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947439488 00000100:00100000:0.0:1789120838.607491:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 76 00000100:00100000:0.0:1789120838.607502:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947439616:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120838.607571:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7492c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947439616:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 71us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120838.607580:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 76 00000100:00100000:0.0:1789120838.607597:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:0.0:1789120838.607605:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947439488:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120838.607632:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947439488:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120838.607639:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:0.0:1789120838.607685:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947439872 00000100:00100000:0.0:1789120838.607689:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947439872 00000100:00100000:0.0:1789120838.607717:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947439744 00000100:00100000:0.0:1789120838.607719:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947439744 00000100:00100000:0.0:1789120838.607740:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:0.0:1789120838.607747:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947439872:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120838.607778:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947439872:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 32us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120838.607785:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:0.0:1789120838.607796:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:0.0:1789120838.607802:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947439744:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120838.612705:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947439744:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 4880us (5524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120838.612729:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00080000:0.0:1789120838.612790:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789120838.612797:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120838.612802:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120838.612806:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789120839.058355:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970572032:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120839.058754:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970572160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120839.058894:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120839.059239:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970572160 00000100:00100000:3.0:1789120839.059250:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970572160 00000100:00080000:2.0:1789120839.059596:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120839.059634:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789120839.059650:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970572160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120839.059694:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120839.060489:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970572160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 840us (1592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120839.060501:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1789120839.060585:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b3a1c0 x1876028970572160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120839.060612:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970572160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120839.060936:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970572288:0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.060981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120839.062161:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970572800:0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.062214:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120839.062258:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970573312:0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.062288:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120839.062332:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970573824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120839.062361:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120839.062396:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789120839.062403:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970572672:0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.062433:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120839.062454:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970573184:0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.062480:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120839.062532:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970573696:0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.062565:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120839.062604:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970572288 00000100:00100000:3.0:1789120839.062613:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970572288 00000100:00100000:3.0:1789120839.062678:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789120839.062689:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970572288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.062762:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970572288:12345-0@lo:400:kworker.0 Request processed in 74us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120839.062771:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789120839.062811:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970573312 00000100:00100000:3.0:1789120839.062815:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970573312 00000100:00100000:3.0:1789120839.062908:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970573184 00000100:00100000:3.0:1789120839.062912:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970573184 00000100:00100000:3.0:1789120839.062929:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970573696 00000100:00100000:3.0:1789120839.062932:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970573696 00000100:00100000:3.0:1789120839.062949:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789120839.062956:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970573312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120839.064606:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970572800 00000100:00100000:0.0:1789120839.064623:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970572800 00000100:00100000:0.0:1789120839.064712:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789120839.064737:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970572800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120839.071625:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970572800:12345-0@lo:400:kworker.0 Request processed in 6892us (9397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120839.071643:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789120839.071752:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970573312:12345-0@lo:400:kworker.0 Request processed in 8784us (9451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120839.071768:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789120839.071847:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789120839.071868:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970573184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.071973:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970573184:12345-0@lo:400:kworker.0 Request processed in 116us (9492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120839.071981:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789120839.072097:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120839.072162:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970572544:0@lo:400:kworker.0 00000100:00100000:1.0:1789120839.072282:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120839.073134:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970573056:0@lo:400:kworker.0 00000100:00100000:0.0:1789120839.073214:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120839.073297:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970572672 00000100:00100000:0.0:1789120839.073319:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970572672 00000100:00100000:0.0:1789120839.073375:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970573056 00000100:00100000:0.0:1789120839.073378:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970573056 00000100:00100000:0.0:1789120839.073408:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789120839.073418:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970572672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120839.073478:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970572672:12345-0@lo:400:kworker.0 Request processed in 61us (11044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120839.073486:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789120839.073516:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789120839.073523:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf663840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970573056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120839.073552:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf663840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970573056:12345-0@lo:400:kworker.0 Request processed in 30us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120839.073558:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:0.0:1789120839.073601:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5e1c0 x1876028970573056/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120839.073618:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970573056:0@lo:400:kworker.0 00000100:00100000:0.0:1789120839.073627:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970573568:0@lo:400:kworker.0 00000100:00100000:0.0:1789120839.073651:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120839.073669:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970573568 00000100:00100000:0.0:1789120839.073672:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970573568 00000100:00100000:0.0:1789120839.073697:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789120839.073703:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf6630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970573568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120839.073731:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf6630c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970573568:12345-0@lo:400:kworker.0 Request processed in 28us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120839.073736:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:0.0:1789120839.073772:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5e580 x1876028970573568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120839.073782:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970573568:0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.073941:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789120839.073959:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970573696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.074055:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970573696:12345-0@lo:400:kworker.0 Request processed in 103us (11489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120839.074064:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789120839.074141:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120839.074147:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120839.074151:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120839.074170:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970573824 00000100:00100000:3.0:1789120839.074177:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970573824 00000100:00100000:3.0:1789120839.074286:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970572032 00000100:00100000:3.0:1789120839.074292:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970572032 00000100:00100000:0.0:1789120839.074292:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789120839.074360:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970572416:0@lo:400:kworker.0 00000100:00100000:0.0:1789120839.074402:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120839.074438:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970572416 00000100:00100000:0.0:1789120839.074444:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970572416 00000100:00100000:3.0:1789120839.074449:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789120839.074460:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970573824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120839.074490:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120839.074741:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970572544 00000100:00100000:1.0:1789120839.074747:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970572544 00000100:00100000:0.0:1789120839.074781:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789120839.074796:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970572416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120839.074804:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789120839.074815:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970572544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120839.074888:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970572544:12345-0@lo:400:kworker.0 Request processed in 76us (2606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120839.074896:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789120839.074960:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970572928:0@lo:400:kworker.0 00000100:00100000:1.0:1789120839.075000:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120839.075036:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970572928 00000100:00100000:1.0:1789120839.075041:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970572928 00000100:00100000:0.0:1789120839.075067:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf663c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970572416:12345-0@lo:400:kworker.0 Request processed in 274us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120839.075079:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789120839.075095:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789120839.075109:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970572928:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789120839.075142:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120839.075161:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b93c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970572928:12345-0@lo:400:kworker.0 Request processed in 56us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120839.075170:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789120839.075182:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970572928:0@lo:400:kworker.0 00000100:00100000:0.0:1789120839.075197:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970573440:0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.075438:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970573824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 979us (13075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120839.075447:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789120839.075466:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789120839.075480:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120839.075487:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970572032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120839.075515:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120839.075630:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970573440 00000100:00100000:0.0:1789120839.075637:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970573440 00000100:00100000:0.0:1789120839.075679:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789120839.075688:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970573440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120839.075731:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf663480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970573440:12345-0@lo:400:kworker.0 Request processed in 45us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120839.075737:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1789120839.075765:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120839.075818:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970573440:0@lo:400:kworker.0 00000100:00100000:1.0:1789120839.075866:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970572544:0@lo:400:kworker.0 00000100:00100000:1.0:1789120839.075902:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970572416:0@lo:400:kworker.0 00000100:00100000:3.0:1789120839.076145:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970572032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 662us (4047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120839.076154:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789120839.076175:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970572672:0@lo:400:kworker.0 00010000:00080000:2.0:1789120839.076199:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5f480 x1876028970573184/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120839.076214:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970573184:0@lo:400:kworker.0 00010000:00080000:2.0:1789120839.076238:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5fc00 x1876028970573696/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789120839.076272:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b91e00 x1876028970572032/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120839.076294:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970572032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789120839.076305:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970573696:0@lo:400:kworker.0 00010000:00080000:2.0:1789120839.076324:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf748000 x1876028970573824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120839.076338:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970573824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120839.076350:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970572288:0@lo:400:kworker.0 00000100:00100000:2.0:1789120839.076444:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970572800:0@lo:400:kworker.0 00010000:00080000:2.0:1789120839.076459:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5de00 x1876028970573312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120839.076467:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970573312:0@lo:400:kworker.0 00010000:00010000:3.0:1789120839.377963:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120839.570267:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120839.570308:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970573952:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789120839.570437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120839.570728:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970573952 00000100:00100000:0.0:1789120839.570757:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970573952 00000100:00100000:0.0:1789120839.570885:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789120839.570898:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970573952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120839.570935:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120839.570998:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970573952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 103us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120839.571007:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1789120839.571154:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf660f00 x1876028970573952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120839.571177:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970573952:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789120840.407196:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120841.426292:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120842.130456:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970574080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120842.130539:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120842.130681:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970574080 00000100:00100000:2.0:1789120842.130690:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970574080 00000100:00100000:2.0:1789120842.130748:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789120842.130758:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970574080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789120842.130792:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120842.130879:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970574080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 122us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120842.130899:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789120842.130986:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970574080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120842.134067:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970574208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789120842.134155:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120842.135262:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970574208 00000100:00100000:0.0:1789120842.135271:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970574208 00000100:00100000:0.0:1789120842.135339:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789120842.135349:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970574208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789120842.135385:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789120842.140435:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970574208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 5079us (6272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120842.140450:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789120842.150851:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970574208:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789120842.451009:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789120842.610809:0:10941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing yml_node 00010000:00010000:2.0:1789120843.476070:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120843.731612:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120843.731661:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120843.731695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120843.731730:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947440128 00000100:00100000:3.0:1789120843.731739:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947440128 00000100:00100000:3.0:1789120843.731798:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947440256 00000100:00100000:3.0:1789120843.731801:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947440256 00000100:00100000:3.0:1789120843.731851:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:3.0:1789120843.731863:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947440128:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120843.732014:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947440000 00000100:00100000:0.0:1789120843.732019:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947440000 00000100:00100000:0.0:1789120843.732054:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 280 00000100:00100000:0.0:1789120843.732061:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2410:x1876028947440000:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120843.732131:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2410:x1876028947440000:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 70us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120843.732139:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 280 00000100:00080000:0.0:1789120843.732172:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789120843.732176:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120843.732456:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:1.0:1789120843.732467:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947440256:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120843.732503:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947440256:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 38us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120843.732509:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:3.0:1789120843.732627:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947440128:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 767us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120843.732634:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:0.0:1789120843.748936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120843.752646:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120843.760449:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947440384 00000100:00100000:3.0:1789120843.760474:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947440384 00000100:00100000:3.0:1789120843.760587:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947440512 00000100:00100000:3.0:1789120843.760592:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947440512 00000100:00100000:3.0:1789120843.760645:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:3.0:1789120843.760658:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf6621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2408:x1876028947440384:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:3.0:1789120843.760715:0:8435:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f32d 00000100:00080000:3.0:1789120843.760752:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9468bf6ac800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1789120843.760806:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1789120843.760843:0:8435:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1789120843.760892:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:1.0:1789120843.760927:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf6612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2408:x1876028947440512:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:1.0:1789120843.760976:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f334 00000100:00080000:1.0:1789120843.760995:0:8434:0:(import.c:65:import_set_state_nolock()) ffff946783caf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789120843.761084:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:3.0:1789120843.761126:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf6621c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+2:2408:x1876028947440384:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 468us (12203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120843.761136:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00080000:0.0:1789120843.761865:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120843.761871:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120843.774651:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf6612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+2:2408:x1876028947440512:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 13720us (22005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120843.774666:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00010000:00010000:1.0:1789120843.774756:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120844.178110:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970574464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120844.178194:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120844.178254:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970574336:0@lo:400:kworker.0 00000100:00100000:1.0:1789120844.178285:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970574592:0@lo:400:kworker.0 00000100:00100000:3.0:1789120844.178294:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120844.178325:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970574976:0@lo:400:kworker.0 00000100:00100000:1.0:1789120844.178338:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120844.178346:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120844.178362:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970575488:0@lo:400:kworker.0 00000100:00100000:1.0:1789120844.178362:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970575104:0@lo:400:kworker.0 00000100:00100000:3.0:1789120844.178384:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120844.178384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120844.178399:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970576000:0@lo:400:kworker.0 00000100:00100000:1.0:1789120844.178399:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970575616:0@lo:400:kworker.0 00000100:00100000:3.0:1789120844.178419:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120844.178419:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120844.178435:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789120844.178435:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789120844.178441:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970574848:0@lo:400:kworker.0 00000100:00100000:1.0:1789120844.178441:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970574720:0@lo:400:kworker.0 00000100:00100000:3.0:1789120844.178461:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120844.178461:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120844.178476:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970575360:0@lo:400:kworker.0 00000100:00100000:1.0:1789120844.178477:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970575232:0@lo:400:kworker.0 00000100:00100000:3.0:1789120844.178497:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120844.178609:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970574592 00000100:00100000:0.0:1789120844.178616:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970574592 00000100:00100000:0.0:1789120844.178651:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970575104 00000100:00100000:0.0:1789120844.178654:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970575104 00000100:00100000:0.0:1789120844.178674:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970575616 00000100:00100000:0.0:1789120844.178676:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970575616 00000100:00100000:0.0:1789120844.178687:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970574848 00000100:00100000:0.0:1789120844.178689:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970574848 00000100:00100000:0.0:1789120844.178703:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789120844.178712:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf700780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970574592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120844.184092:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120844.184152:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970575744:0@lo:400:kworker.0 00000100:00100000:1.0:1789120844.184229:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120844.184257:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970576128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120844.184287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120844.184327:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120844.184334:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970576256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120844.184356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120844.184391:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970575232 00000100:00100000:1.0:1789120844.184397:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970575232 00000100:00100000:1.0:1789120844.184437:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970575744 00000100:00100000:1.0:1789120844.184440:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970575744 00000100:00100000:1.0:1789120844.184459:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789120844.184469:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf703840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970575104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.185548:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970575488 00000100:00100000:2.0:1789120844.185557:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970575488 00000100:00100000:2.0:1789120844.185612:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970576000 00000100:00100000:2.0:1789120844.185615:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970576000 00000100:00100000:2.0:1789120844.185629:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970575360 00000100:00100000:2.0:1789120844.185632:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970575360 00000100:00100000:2.0:1789120844.185649:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789120844.185657:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970575488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.185729:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970575488:12345-0@lo:400:kworker.0 Request processed in 72us (7343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.185737:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789120844.185752:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789120844.185758:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970576000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.185787:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970576000:12345-0@lo:400:kworker.0 Request processed in 29us (7367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.185794:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789120844.185803:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789120844.185809:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9e0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970575360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.185856:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9e0b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970575360:12345-0@lo:400:kworker.0 Request processed in 45us (7356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.185862:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789120844.186063:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970574976 00000100:00100000:2.0:1789120844.186067:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970574976 00000100:00100000:2.0:1789120844.186087:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970574720 00000100:00100000:2.0:1789120844.186090:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970574720 00000100:00100000:2.0:1789120844.186104:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789120844.186109:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970574976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.186146:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970574976:12345-0@lo:400:kworker.0 Request processed in 36us (7798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.186153:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789120844.186165:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789120844.186172:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970574720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.186224:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970574720:12345-0@lo:400:kworker.0 Request processed in 53us (7762us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.186230:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789120844.186251:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970574336 00000100:00100000:2.0:1789120844.186254:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970574336 00000100:00100000:2.0:1789120844.186290:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789120844.186296:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970574336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.186329:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970574336:12345-0@lo:400:kworker.0 Request processed in 33us (8034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.186336:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789120844.186364:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970574464 00000100:00100000:2.0:1789120844.186368:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970574464 00000100:00100000:2.0:1789120844.186384:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970576128 00000100:00100000:2.0:1789120844.186387:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970576128 00000100:00100000:2.0:1789120844.186396:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970576256 00000100:00100000:2.0:1789120844.186398:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970576256 00000100:00100000:2.0:1789120844.186407:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789120844.186413:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970574464:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789120844.186441:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120844.186475:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970574464:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (8280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.186481:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789120844.186493:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789120844.186498:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970576128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120844.186511:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120844.186536:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970576128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 38us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.186541:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789120844.186552:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789120844.186558:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf702d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970576256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120844.186567:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120844.186589:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf702d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970576256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 31us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.186594:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789120844.186624:0:6519:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789120844.186632:0:6519:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:2.0:1789120844.186674:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120844.186678:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120844.186680:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789120844.186682:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120844.186696:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789120844.186704:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789120844.186711:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970575616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.186744:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7030c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970575616:12345-0@lo:400:kworker.0 Request processed in 34us (8324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.186760:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789120844.186774:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789120844.186780:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789120844.186786:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970574848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.186817:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970574848:12345-0@lo:400:kworker.0 Request processed in 32us (8356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.186846:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789120844.186856:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789120844.186862:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789120844.186868:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf702940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970575232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.186898:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf702940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970575232:12345-0@lo:400:kworker.0 Request processed in 30us (2817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.186904:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789120844.186916:0:6518:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789120844.186922:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789120844.186927:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf700f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970575744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.186956:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf700f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970575744:12345-0@lo:400:kworker.0 Request processed in 29us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.186961:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00010000:00080000:2.0:1789120844.187255:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf661e00 x1876028970576256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120844.187276:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970576256:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789120844.187291:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf660000 x1876028970576128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120844.187304:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970576128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120844.187328:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970574720:0@lo:400:kworker.0 00010000:00080000:2.0:1789120844.187340:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b93840 x1876028970575232/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120844.187348:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970575232:0@lo:400:kworker.0 00010000:00080000:2.0:1789120844.187363:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ec780 x1876028970575744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120844.187371:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970575744:0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.187383:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970575616:0@lo:400:kworker.0 00000100:00100000:1.0:1789120844.187581:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf703840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970575104:12345-0@lo:400:kworker.0 Request processed in 3113us (9195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120844.187588:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789120844.189218:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf700780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970574592:12345-0@lo:400:kworker.0 Request processed in 10498us (10870us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120844.189232:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789120844.192112:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970574592:0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.192142:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970575104:0@lo:400:kworker.0 00010000:00080000:3.0:1789120844.192888:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b90000 x1876028970575360/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120844.192904:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970575360:0@lo:400:kworker.0 00000100:00100000:3.0:1789120844.192919:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970575872:0@lo:400:kworker.0 00000100:00100000:3.0:1789120844.193070:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120844.193104:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970574976:0@lo:400:kworker.0 00010000:00080000:3.0:1789120844.193117:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b930c0 x1876028970575488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120844.193125:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970575488:0@lo:400:kworker.0 00010000:00080000:3.0:1789120844.193136:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ecb40 x1876028970576000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120844.193143:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970576000:0@lo:400:kworker.0 00010000:00080000:3.0:1789120844.193154:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5d2c0 x1876028970574464/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120844.193171:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970574464:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120844.193192:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b92d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970574336:0@lo:400:kworker.0 00000100:00100000:3.0:1789120844.193224:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b90780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970574848:0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.197470:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970575872 00000100:00100000:2.0:1789120844.197497:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970575872 00000100:00100000:2.0:1789120844.197596:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789120844.197608:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970575872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120844.197719:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970575872:12345-0@lo:400:kworker.0 Request processed in 114us (4648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120844.197727:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1789120844.197785:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789120844.200461:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ee940 x1876028970575872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120844.200480:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970575872:0@lo:400:kworker.0 00010000:00010000:0.0:1789120844.498077:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120844.690704:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970576384:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789120844.690794:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120844.691228:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970576384 00000100:00100000:0.0:1789120844.691239:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970576384 00000100:00100000:0.0:1789120844.691294:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789120844.691305:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970576384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120844.691340:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120844.691404:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970576384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120844.691412:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1789120844.691562:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf662940 x1876028970576384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120844.691597:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970576384:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789120845.528054:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789120846.277781:0:11126:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.139 00010000:00010000:1.0:1789120846.549268:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120847.250054:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120847.250086:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970576512:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789120847.250358:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120847.250505:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970576512 00000100:00100000:0.0:1789120847.250515:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970576512 00000100:00100000:0.0:1789120847.250578:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789120847.250596:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970576512:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789120847.250644:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789120847.250709:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970576512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120847.250717:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789120847.250803:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970576512:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120847.252050:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120847.252072:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970576640:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120847.252166:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120847.252323:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970576640 00000100:00100000:2.0:1789120847.252331:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970576640 00000100:00100000:2.0:1789120847.252388:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789120847.252398:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf661680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970576640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789120847.252434:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120847.252484:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf661680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970576640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120847.252492:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789120847.252620:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970576640:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1789120847.570223:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120848.608866:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120848.846124:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120848.846220:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120848.846259:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120848.846350:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947440640 00000100:00100000:1.0:1789120848.846363:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947440640 00000100:00100000:1.0:1789120848.846447:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 282 00000100:00100000:1.0:1789120848.846460:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2410:x1876028947440640:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120848.846554:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2410:x1876028947440640:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 96us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120848.846562:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 282 00000100:00100000:2.0:1789120848.847435:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947440896 00000100:00100000:2.0:1789120848.847446:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947440896 00000100:00100000:2.0:1789120848.847521:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947440768 00000100:00100000:2.0:1789120848.847525:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947440768 00000100:00100000:2.0:1789120848.847549:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 92 00000100:00100000:2.0:1789120848.847559:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947440896:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120848.847622:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947440896:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 65us (1401us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120848.847629:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 92 00000100:00100000:2.0:1789120848.847645:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 93 00000100:00100000:2.0:1789120848.847651:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947440768:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120848.847676:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947440768:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120848.847682:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 93 00000100:00080000:1.0:1789120848.848108:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120848.848114:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1789120849.137021:0:11223:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.139 00000100:00100000:3.0:1789120849.298278:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970577152:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.298395:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.298462:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970577664:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.298493:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.298519:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970578176:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.298541:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.298569:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1789120849.298574:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970576768:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.298604:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.298624:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970577280:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.298647:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.298663:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970577792:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.298684:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.298702:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970578304:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.298735:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.298772:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970576896:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.298798:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.298852:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970577408:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.298878:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.298897:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970577920:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.298921:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.298941:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789120849.298946:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970577024:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.298968:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.298983:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970577536:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.299012:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.299029:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970578048:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.299049:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.299081:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970577664 00000100:00100000:3.0:1789120849.299090:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970577664 00000100:00100000:3.0:1789120849.299160:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970578176 00000100:00100000:3.0:1789120849.299164:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970578176 00000100:00100000:3.0:1789120849.299179:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970577792 00000100:00100000:3.0:1789120849.299181:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970577792 00000100:00100000:3.0:1789120849.299196:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970578304 00000100:00100000:3.0:1789120849.299199:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970578304 00000100:00100000:3.0:1789120849.299217:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789120849.299227:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970577664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.299291:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970577664:12345-0@lo:400:kworker.0 Request processed in 65us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.299299:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789120849.299318:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789120849.299323:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970578176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.299350:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970578176:12345-0@lo:400:kworker.0 Request processed in 27us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.299355:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789120849.299365:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789120849.299370:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970577792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.299396:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970577792:12345-0@lo:400:kworker.0 Request processed in 26us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.299402:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789120849.299425:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789120849.299437:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970578304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.299467:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970578304:12345-0@lo:400:kworker.0 Request processed in 31us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.299473:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789120849.299497:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970576768 00000100:00100000:3.0:1789120849.299501:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970576768 00000100:00100000:3.0:1789120849.299528:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789120849.299534:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970576768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.299565:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970576768:12345-0@lo:400:kworker.0 Request processed in 31us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.299572:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789120849.299603:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970577280 00000100:00100000:3.0:1789120849.299607:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970577280 00000100:00100000:3.0:1789120849.299625:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970577024 00000100:00100000:3.0:1789120849.299627:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970577024 00000100:00100000:3.0:1789120849.299639:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789120849.299645:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970577280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.299675:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970577280:12345-0@lo:400:kworker.0 Request processed in 31us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.299681:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789120849.299691:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789120849.299695:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970577024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.299725:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970577024:12345-0@lo:400:kworker.0 Request processed in 29us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.299731:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789120849.299756:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970577152 00000100:00100000:3.0:1789120849.299760:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970577152 00000100:00100000:3.0:1789120849.299785:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970576896 00000100:00100000:3.0:1789120849.299788:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970576896 00000100:00100000:3.0:1789120849.299798:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970577408 00000100:00100000:3.0:1789120849.299800:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970577408 00000100:00100000:3.0:1789120849.299812:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970577920 00000100:00100000:3.0:1789120849.299814:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970577920 00000100:00100000:3.0:1789120849.299850:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970577536 00000100:00100000:3.0:1789120849.299854:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970577536 00000100:00100000:3.0:1789120849.299864:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970578048 00000100:00100000:3.0:1789120849.299866:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970578048 00000100:00100000:3.0:1789120849.299883:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789120849.299889:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970577152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.299918:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970577152:12345-0@lo:400:kworker.0 Request processed in 31us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.299924:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789120849.299936:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789120849.299940:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970576896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.299965:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970576896:12345-0@lo:400:kworker.0 Request processed in 24us (1166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.299971:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789120849.299980:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789120849.299985:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970577408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.300008:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970577408:12345-0@lo:400:kworker.0 Request processed in 23us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.300013:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789120849.300022:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789120849.300028:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970577920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.300051:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970577920:12345-0@lo:400:kworker.0 Request processed in 24us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.300062:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789120849.300072:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789120849.300078:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970577536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.300107:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970577536:12345-0@lo:400:kworker.0 Request processed in 29us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.300112:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789120849.300123:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789120849.300139:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970578048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.300166:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970578048:12345-0@lo:400:kworker.0 Request processed in 37us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120849.300172:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1789120849.300255:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120849.300260:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789120849.300262:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120849.300265:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120849.300276:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120849.300288:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970578432:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120849.300321:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120849.300373:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970577024:0@lo:400:kworker.0 00010000:00080000:3.0:1789120849.300389:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99c7840 x1876028970577536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120849.300401:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970577536:0@lo:400:kworker.0 00010000:00080000:3.0:1789120849.300410:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d0f00 x1876028970578048/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120849.300419:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970578048:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.300436:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970576896:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.300446:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970577408:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.300457:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970577920:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.300499:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970576768:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.300512:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970577280:0@lo:400:kworker.0 00010000:00080000:3.0:1789120849.300525:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893a7f840 x1876028970577792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120849.300534:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970577792:0@lo:400:kworker.0 00010000:00080000:3.0:1789120849.300546:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b243c0 x1876028970578304/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120849.300555:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970578304:0@lo:400:kworker.0 00000100:00100000:3.0:1789120849.300566:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eae580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970577152:0@lo:400:kworker.0 00010000:00080000:3.0:1789120849.300574:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99c7c00 x1876028970577664/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120849.300583:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970577664:0@lo:400:kworker.0 00010000:00080000:3.0:1789120849.300593:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b25e00 x1876028970578176/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120865 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120849.300601:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b25e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970578176:0@lo:400:kworker.0 00000100:00100000:0.0:1789120849.300807:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970578432 00000100:00100000:0.0:1789120849.300813:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970578432 00000100:00100000:0.0:1789120849.300868:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789120849.300876:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970578432:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789120849.300907:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120849.300950:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970578432:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120849.300957:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789120849.300989:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120849.300997:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970578688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120849.301027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120849.301052:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970578688 00000100:00100000:0.0:1789120849.301056:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970578688 00000100:00100000:0.0:1789120849.301072:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789120849.301077:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf662d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970578688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120849.301088:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120849.301113:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf662d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970578688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120849.301125:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1789120849.301166:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf661e00 x1876028970578688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120849.301182:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf661e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970578688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120849.301218:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120849.301224:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970578560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120849.301247:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120849.301269:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970578560 00000100:00100000:0.0:1789120849.301272:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970578560 00000100:00100000:0.0:1789120849.301290:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789120849.301295:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf661e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970578560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120849.301311:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120849.301340:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf661e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970578560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120849.301347:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789120849.301369:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf660000 x1876028970578560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120849.301382:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970578560:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789120849.301805:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b9c383c0 x1876028970578432/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120849.301848:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c383c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970578432:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1789120849.618210:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789120849.813649:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000020:00000080:3.0:1789120849.813659:0:8428:0:(genops.c:885:class_export_put()) final put ffff9468bf6ab000/3dde8702-0a22-4cb8-87f3-66b167299fdd 00000020:00000080:3.0:1789120849.813689:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468bf6ab000/3dde8702-0a22-4cb8-87f3-66b167299fdd for lustre-OST0000 00000020:00000080:3.0:1789120849.813730:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468bf6ac800 for lustre-OST0000 00000100:00100000:0.0:1789120849.816883:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120849.816921:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970578816:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789120849.817100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120849.817207:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970578816 00000100:00100000:0.0:1789120849.817216:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970578816 00000100:00100000:0.0:1789120849.817347:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789120849.817613:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf661a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970578816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120849.817650:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120849.817776:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf661a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970578816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 168us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120849.817784:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1789120849.817858:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf703480 x1876028970578816/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120865 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120849.817881:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970578816:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1789120849.821954:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000020:00000080:1.0:1789120849.821968:0:9516:0:(genops.c:885:class_export_put()) final put ffff946783caf000/3dde8702-0a22-4cb8-87f3-66b167299fdd 00000020:00000080:3.0:1789120849.822349:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff946783caf000/3dde8702-0a22-4cb8-87f3-66b167299fdd for lustre-OST0001 00000020:00000080:3.0:1789120849.822432:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783caf800 for lustre-OST0001 00010000:00010000:1.0:1789120850.643452:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120851.666375:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789120851.668353:0:11320:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.139 00000100:00100000:0.0:1789120852.371410:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf701e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970578944:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120852.371501:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120852.371576:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120852.371582:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970579072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120852.371608:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120852.371679:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970578944 00000100:00100000:3.0:1789120852.371688:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970578944 00000100:00100000:3.0:1789120852.371725:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970579072 00000100:00100000:3.0:1789120852.371728:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970579072 00000100:00100000:3.0:1789120852.371744:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789120852.371752:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970578944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120852.371785:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789120852.371870:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970578944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120852.371878:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789120852.371896:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789120852.371902:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970579072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789120852.371919:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789120852.371947:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970579072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 45us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120852.371953:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789120852.373206:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970579072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120852.373225:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf701e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970578944:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789120852.691699:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789120853.195660:0:11368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Sep 11 06:00:51 EDT 2026 00010000:00010000:0.0:1789120853.717163:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120853.966300:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120853.966437:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947441024 00000100:00100000:2.0:1789120853.966447:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947441024 00000100:00100000:2.0:1789120853.966509:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 284 00000100:00100000:2.0:1789120853.966525:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2411:x1876028947441024:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120853.966607:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2411:x1876028947441024:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 83us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120853.966616:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 284 00000100:00100000:2.0:1789120853.967538:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120853.967860:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947441152 00000100:00100000:3.0:1789120853.967866:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947441152 00000100:00100000:3.0:1789120853.967937:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 100 00000100:00100000:3.0:1789120853.967947:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947441152:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120853.967999:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947441152:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 54us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120853.968006:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 100 00000100:00080000:2.0:1789120853.968394:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120853.974890:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120853.974961:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947441280 00000100:00100000:3.0:1789120853.974984:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947441280 00000100:00100000:1.0:1789120853.975407:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00100000:1.0:1789120853.975424:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947441280:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120853.975509:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947441280:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 89us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120853.975517:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00080000:2.0:1789120853.976749:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789120854.420551:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970579200:0@lo:400:kworker.0 00000100:00100000:0.0:1789120854.420660:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120854.420737:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970579712:0@lo:400:kworker.0 00000100:00100000:0.0:1789120854.420770:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120854.420796:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970580224:0@lo:400:kworker.0 00000100:00100000:0.0:1789120854.420846:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120854.420886:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970580736:0@lo:400:kworker.0 00000100:00100000:0.0:1789120854.420913:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120854.420943:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789120854.420950:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970579328:0@lo:400:kworker.0 00000100:00100000:0.0:1789120854.420981:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120854.421002:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970579840:0@lo:400:kworker.0 00000100:00100000:0.0:1789120854.421023:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120854.421040:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970580352:0@lo:400:kworker.0 00000100:00100000:0.0:1789120854.421063:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120854.421079:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970580864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120854.421115:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120854.421153:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf6621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970579456:0@lo:400:kworker.0 00000100:00100000:0.0:1789120854.421179:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120854.421198:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970579968:0@lo:400:kworker.0 00000100:00100000:0.0:1789120854.421221:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120854.421487:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970580480:0@lo:400:kworker.0 00000100:00100000:0.0:1789120854.421513:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120854.421548:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970580992:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120854.421572:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120854.422452:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970579328 00000100:00100000:2.0:1789120854.422465:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970579328 00000100:00100000:2.0:1789120854.422517:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970579840 00000100:00100000:2.0:1789120854.422521:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970579840 00000100:00100000:2.0:1789120854.422559:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970580352 00000100:00100000:2.0:1789120854.422562:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970580352 00000100:00100000:2.0:1789120854.422576:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970579968 00000100:00100000:2.0:1789120854.422578:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970579968 00000100:00100000:2.0:1789120854.422592:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970580480 00000100:00100000:2.0:1789120854.422594:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970580480 00000100:00100000:2.0:1789120854.422613:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789120854.422624:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970579328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120854.422716:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970579328:12345-0@lo:400:kworker.0 Request processed in 93us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120854.422725:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789120854.422749:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789120854.422756:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970579840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120854.422791:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970579840:12345-0@lo:400:kworker.0 Request processed in 36us (1768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120854.422797:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789120854.422860:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789120854.422867:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970580352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120854.422903:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970580352:12345-0@lo:400:kworker.0 Request processed in 37us (1840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120854.422908:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789120854.422918:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789120854.422922:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970579968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120854.422949:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970579968:12345-0@lo:400:kworker.0 Request processed in 26us (1728us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120854.422955:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789120854.422965:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789120854.422970:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970580480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120854.422998:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970580480:12345-0@lo:400:kworker.0 Request processed in 28us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120854.423004:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789120854.423056:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf660f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970579328:0@lo:400:kworker.0 00000100:00100000:2.0:1789120854.423070:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970579840:0@lo:400:kworker.0 00000100:00100000:2.0:1789120854.423092:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970580352:0@lo:400:kworker.0 00000100:00080000:1.0:1789120854.425359:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120854.425373:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120854.425536:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970579200 00000100:00100000:3.0:1789120854.425551:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970579200 00000100:00100000:3.0:1789120854.425638:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789120854.425650:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970579200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120854.425770:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970579200:12345-0@lo:400:kworker.0 Request processed in 122us (5111us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120854.425780:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789120854.425846:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970580224 00000100:00100000:3.0:1789120854.425851:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970580224 00000100:00100000:3.0:1789120854.425892:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970580736 00000100:00100000:3.0:1789120854.425896:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970580736 00000100:00100000:3.0:1789120854.425920:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789120854.425928:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970580224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120854.425966:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970580224:12345-0@lo:400:kworker.0 Request processed in 40us (5120us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120854.425973:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789120854.425985:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789120854.425991:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970580736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120854.426048:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970580736:12345-0@lo:400:kworker.0 Request processed in 57us (5134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120854.426053:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1789120854.426102:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120854.426106:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120854.426152:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970579712 00000100:00100000:3.0:1789120854.426156:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970579712 00000100:00100000:3.0:1789120854.426178:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970579456 00000100:00100000:3.0:1789120854.426180:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970579456 00000100:00100000:3.0:1789120854.426194:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789120854.426200:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970579712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120854.426418:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6612c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970579200:0@lo:400:kworker.0 00010000:00080000:1.0:1789120854.426447:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ef480 x1876028970580224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120854.426461:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970580224:0@lo:400:kworker.0 00010000:00080000:1.0:1789120854.426475:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bcf840 x1876028970580736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120854.426484:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcf840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970580736:0@lo:400:kworker.0 00000100:00100000:3.0:1789120854.426580:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970579712:12345-0@lo:400:kworker.0 Request processed in 379us (5809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120854.426588:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789120854.426603:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789120854.426609:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970579456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120854.426645:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970579456:12345-0@lo:400:kworker.0 Request processed in 36us (5464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120854.426651:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789120854.426693:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970579584:0@lo:400:kworker.0 00000100:00100000:3.0:1789120854.426734:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120854.426812:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970580096:0@lo:400:kworker.0 00000100:00100000:3.0:1789120854.426865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120854.426885:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970580608:0@lo:400:kworker.0 00000100:00100000:3.0:1789120854.426907:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120854.426922:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf701680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970581120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120854.426962:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970580096 00000100:00100000:3.0:1789120854.426966:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970580096 00000100:00100000:3.0:1789120854.426996:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970580608 00000100:00100000:3.0:1789120854.426999:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970580608 00000100:00100000:3.0:1789120854.427017:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789120854.427023:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970580096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120854.427061:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970580096:12345-0@lo:400:kworker.0 Request processed in 37us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120854.427068:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789120854.427090:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789120854.427098:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970580608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120854.427128:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970580608:12345-0@lo:400:kworker.0 Request processed in 31us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120854.427133:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1789120854.427157:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120854.427160:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120854.427264:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970579712:0@lo:400:kworker.0 00000100:00100000:0.0:1789120854.431510:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf6621c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970579456:0@lo:400:kworker.0 00010000:00080000:0.0:1789120854.431537:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ec780 x1876028970579968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120854.431548:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970579968:0@lo:400:kworker.0 00010000:00080000:0.0:1789120854.431594:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b06580 x1876028970580480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120854.431604:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970580480:0@lo:400:kworker.0 00000100:00100000:2.0:1789120854.431755:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970579584 00000100:00100000:2.0:1789120854.431765:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970579584 00000100:00100000:1.0:1789120854.431917:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120854.432181:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789120854.432195:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970579584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120854.432312:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970579584:12345-0@lo:400:kworker.0 Request processed in 120us (5578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120854.432334:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789120854.432496:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970579584:0@lo:400:kworker.0 00010000:00080000:1.0:1789120854.432513:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839eed00 x1876028970580096/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120854.432524:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970580096:0@lo:400:kworker.0 00010000:00080000:1.0:1789120854.432537:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b07c00 x1876028970580608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120870 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120854.432546:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970580608:0@lo:400:kworker.0 00000100:00100000:3.0:1789120854.439337:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970580864 00000100:00100000:3.0:1789120854.439359:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970580864 00000100:00100000:3.0:1789120854.439437:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970580992 00000100:00100000:3.0:1789120854.439441:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970580992 00000100:00100000:3.0:1789120854.439452:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970581120 00000100:00100000:3.0:1789120854.439455:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970581120 00000100:00100000:3.0:1789120854.439476:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789120854.439486:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970580864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120854.439534:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120854.439669:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970580864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 178us (18547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120854.439676:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789120854.439713:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789120854.439719:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970580992:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120854.439729:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120854.439771:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970580992:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (18198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120854.439777:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789120854.439786:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789120854.439791:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf702580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970581120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120854.439809:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120854.439864:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf702580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970581120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (7950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120854.439870:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789120854.439899:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bcd680 x1876028970580864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789120854.439901:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf701680 x1876028970581120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120854.439924:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf701680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970581120:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120854.439924:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970580864:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789120854.440935:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783cf8780 x1876028970580992/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120854.440957:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970580992:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789120854.739380:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120854.930608:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf701a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970581248:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789120854.930725:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120854.931046:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970581248 00000100:00100000:1.0:1789120854.931058:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970581248 00000100:00100000:1.0:1789120854.931131:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789120854.931159:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970581248:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789120854.931192:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120854.932410:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970581248:12345-0@lo:13:osp-pre-1-1.0 Request processed in 1240us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120854.932427:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1789120854.933315:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf701a40 x1876028970581248/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120854.933347:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf701a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970581248:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789120855.761965:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120856.787074:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120857.492386:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120857.492414:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970581376:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120857.492513:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120857.492565:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970581376 00000100:00100000:1.0:1789120857.492572:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970581376 00000100:00100000:3.0:1789120857.492593:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120857.492614:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970581504:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120857.492624:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789120857.492636:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970581376:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120857.492661:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:1.0:1789120857.492674:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120857.492741:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970581376:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120857.492748:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789120857.492764:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970581504 00000100:00100000:1.0:1789120857.492767:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970581504 00000100:00100000:1.0:1789120857.492789:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789120857.492795:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970581504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789120857.492810:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789120857.492871:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970581504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120857.492878:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789120857.493013:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7003c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970581504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789120857.493048:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970581376:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789120857.811285:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120858.835360:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120859.087090:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120859.087137:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120859.087166:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120859.087195:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947441408 00000100:00100000:1.0:1789120859.087205:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947441408 00000100:00100000:1.0:1789120859.087265:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 286 00000100:00100000:1.0:1789120859.087275:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2411:x1876028947441408:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120859.087339:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2411:x1876028947441408:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 66us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120859.087347:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 286 00000100:00100000:1.0:1789120859.087378:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947441536 00000100:00100000:1.0:1789120859.087382:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947441536 00000100:00100000:1.0:1789120859.087414:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947441664 00000100:00100000:1.0:1789120859.087418:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947441664 00000100:00100000:1.0:1789120859.087436:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 108 00000100:00100000:1.0:1789120859.087443:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf700b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947441536:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120859.087472:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf700b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947441536:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120859.087479:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 108 00000100:00100000:1.0:1789120859.087490:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 109 00000100:00100000:1.0:1789120859.087496:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947441664:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120859.087518:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7003c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947441664:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 21us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120859.087524:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 109 00000100:00080000:1.0:1789120859.087542:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120859.087545:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120859.545250:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf703c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970581760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120859.545370:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120859.545460:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120859.545468:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf701a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970581888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120859.545496:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120859.545557:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970581760 00000100:00100000:1.0:1789120859.545567:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970581760 00000100:00100000:1.0:1789120859.545629:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970581888 00000100:00100000:1.0:1789120859.545633:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970581888 00000100:00100000:1.0:1789120859.545653:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789120859.545664:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf701680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970581760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120859.545715:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120859.545766:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf701680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970581760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120859.545774:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789120859.545816:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789120859.545850:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf701e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970581888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120859.545868:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120859.545896:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf701e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970581888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120859.545902:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789120859.545923:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120859.545927:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789120859.545958:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf701a40 x1876028970581888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120859.545979:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf701a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970581888:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789120859.545991:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf703c00 x1876028970581760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120859.546001:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf703c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970581760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120859.547563:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970582016:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.547650:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.547708:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970582528:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.547737:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.547769:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970583040:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.548934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.549064:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1789120859.549075:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970581632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789120859.549123:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.549146:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970582144:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.549172:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.549254:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970582656:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.549277:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.549295:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970583168:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.549317:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.549368:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970582400:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.549391:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.549406:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970582912:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.549424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.549444:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789120859.549449:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970582272:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.549469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.549502:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970582784:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.549520:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.549529:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970583296:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.549546:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120859.549577:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970582016 00000100:00100000:2.0:1789120859.549585:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970582016 00000100:00100000:2.0:1789120859.549640:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789120859.549649:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970582016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120859.550130:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970582528 00000100:00100000:0.0:1789120859.550137:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970582528 00000100:00100000:0.0:1789120859.550167:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970582272 00000100:00100000:0.0:1789120859.550171:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970582272 00000100:00100000:0.0:1789120859.550199:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789120859.550209:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf662940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970582528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120859.550275:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf662940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970582528:12345-0@lo:400:kworker.0 Request processed in 68us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120859.550283:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789120859.550307:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789120859.550313:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970582272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120859.550346:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970582272:12345-0@lo:400:kworker.0 Request processed in 34us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120859.550367:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789120859.550412:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970582528:0@lo:400:kworker.0 00000100:00100000:0.0:1789120859.550441:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970582272:0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.551009:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970582016:12345-0@lo:400:kworker.0 Request processed in 1355us (3354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120859.551018:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1789120859.551081:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970583040 00000100:00100000:2.0:1789120859.551086:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970583040 00000100:00100000:2.0:1789120859.551132:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970582144 00000100:00100000:2.0:1789120859.551135:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970582144 00000100:00100000:2.0:1789120859.551148:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970582656 00000100:00100000:2.0:1789120859.551151:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970582656 00000100:00100000:2.0:1789120859.551162:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970583168 00000100:00100000:2.0:1789120859.551164:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970583168 00000100:00100000:2.0:1789120859.551187:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970582400 00000100:00100000:2.0:1789120859.551190:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970582400 00000100:00100000:2.0:1789120859.551203:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970582784 00000100:00100000:2.0:1789120859.551206:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970582784 00000100:00100000:2.0:1789120859.551221:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789120859.551227:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf6621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970583040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.551264:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf6621c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970583040:12345-0@lo:400:kworker.0 Request processed in 38us (3458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120859.551270:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789120859.551281:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789120859.551299:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970582144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.551329:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970582144:12345-0@lo:400:kworker.0 Request processed in 30us (2156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120859.551335:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789120859.551346:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789120859.551351:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970582656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.551375:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970582656:12345-0@lo:400:kworker.0 Request processed in 24us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120859.551381:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789120859.551389:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789120859.551395:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970583168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.551422:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b92d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970583168:12345-0@lo:400:kworker.0 Request processed in 27us (2104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120859.551427:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789120859.551437:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789120859.551443:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970582400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.551474:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970582400:12345-0@lo:400:kworker.0 Request processed in 31us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120859.551480:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789120859.551490:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789120859.551496:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970582784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.551525:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970582784:12345-0@lo:400:kworker.0 Request processed in 29us (2004us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120859.551531:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789120859.551554:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970581632 00000100:00100000:2.0:1789120859.551564:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970581632 00000100:00100000:2.0:1789120859.551598:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789120859.551604:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf6612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970581632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789120859.551622:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120859.551657:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf6612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970581632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120859.551664:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789120859.551719:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970582912 00000100:00100000:2.0:1789120859.551724:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970582912 00000100:00100000:2.0:1789120859.551751:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970583296 00000100:00100000:2.0:1789120859.551754:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970583296 00000100:00100000:2.0:1789120859.551800:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789120859.554481:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970582912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.554618:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b91a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970582912:12345-0@lo:400:kworker.0 Request processed in 2810us (5191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120859.554632:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789120859.554670:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789120859.554759:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970583296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120859.555119:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970583296:12345-0@lo:400:kworker.0 Request processed in 439us (5569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120859.555128:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789120859.555163:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120859.555171:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120859.555174:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789120859.556157:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789120859.558347:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf74bc00 x1876028970581632/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120875 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120859.558383:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970581632:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120859.558402:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970582144:0@lo:400:kworker.0 00000100:00100000:0.0:1789120859.558417:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970582656:0@lo:400:kworker.0 00010000:00080000:0.0:1789120859.558431:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ecf00 x1876028970583168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120859.558440:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970583168:0@lo:400:kworker.0 00000100:00100000:0.0:1789120859.558453:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970582016:0@lo:400:kworker.0 00000100:00100000:0.0:1789120859.558467:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970583040:0@lo:400:kworker.0 00010000:00080000:0.0:1789120859.558530:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ec780 x1876028970582784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120859.558539:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970582784:0@lo:400:kworker.0 00010000:00080000:0.0:1789120859.558554:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ecb40 x1876028970583296/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120859.558563:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970583296:0@lo:400:kworker.0 00000100:00100000:0.0:1789120859.558577:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfa940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970582400:0@lo:400:kworker.0 00010000:00080000:0.0:1789120859.558608:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ee940 x1876028970582912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120875 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120859.558616:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970582912:0@lo:400:kworker.0 00010000:00010000:1.0:1789120859.861155:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120860.056547:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970583424:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789120860.056664:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120860.056802:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970583424 00000100:00100000:0.0:1789120860.056863:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970583424 00000100:00100000:0.0:1789120860.056927:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789120860.056938:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970583424:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120860.056969:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120860.057025:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970583424:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120860.057043:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1789120860.057103:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99c6d00 x1876028970583424/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120860.057128:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970583424:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789120860.886913:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120861.926334:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120862.610389:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970583552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120862.610492:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120862.610732:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970583680:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120862.610766:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120862.610804:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970583552 00000100:00100000:1.0:1789120862.610813:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970583552 00000100:00100000:1.0:1789120862.610880:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970583680 00000100:00100000:1.0:1789120862.610884:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970583680 00000100:00100000:1.0:1789120862.611383:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789120862.611395:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970583552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789120862.611440:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120862.611491:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970583552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 99us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120862.611498:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789120862.611517:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789120862.611523:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970583680:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789120862.611539:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789120862.611575:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970583680:12345-0@lo:41:osp-pre-0-1.0 Request processed in 52us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120862.611581:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789120862.611627:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b93840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970583552:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120862.611811:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970583680:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789120862.935050:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120863.955617:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120864.207281:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120864.207468:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120864.207506:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120864.207510:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947441792 00000100:00100000:1.0:1789120864.207523:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947441792 00000100:00100000:0.0:1789120864.207578:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947441920 00000100:00100000:0.0:1789120864.207582:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947441920 00000100:00100000:1.0:1789120864.207598:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 288 00000100:00100000:1.0:1789120864.207609:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2412:x1876028947441792:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120864.207642:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947442048 00000100:00100000:0.0:1789120864.207646:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947442048 00000100:00100000:0.0:1789120864.207667:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:0.0:1789120864.207674:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947441920:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120864.207706:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2412:x1876028947441792:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 98us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120864.207706:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947441920:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 33us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120864.207713:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:1.0:1789120864.207718:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 288 00000100:00100000:0.0:1789120864.207739:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00100000:0.0:1789120864.207745:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947442048:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120864.207785:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947442048:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 39us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120864.207791:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00080000:0.0:1789120864.207809:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789120864.207814:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120864.658190:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120864.658219:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970583808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120864.658317:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120864.659065:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970583808 00000100:00100000:1.0:1789120864.659078:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970583808 00000100:00100000:1.0:1789120864.659219:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789120864.659235:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf703c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970583808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120864.659282:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120864.659358:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf703c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970583808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120864.659367:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:1.0:1789120864.659395:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789120864.659438:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf703480 x1876028970583808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120864.659464:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970583808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120864.660044:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120864.660060:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970583936:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120864.660117:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.660168:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970583936 00000100:00100000:3.0:1789120864.660173:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970583936 00000100:00100000:3.0:1789120864.660215:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789120864.660224:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970583936:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120864.660249:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120864.660288:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970583936:12345-0@lo:13:osp-pre-0-1.0 Request processed in 65us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120864.660295:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789120864.660319:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789120864.660341:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5f840 x1876028970583936/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120864.660356:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970583936:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789120864.664624:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970584064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120864.664732:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120864.664847:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970584064 00000100:00100000:2.0:1789120864.664857:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970584064 00000100:00100000:2.0:1789120864.664942:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789120864.664953:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970584064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120864.664993:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120864.665045:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970584064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120864.665052:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1789120864.665080:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789120864.665112:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b903c0 x1876028970584064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120880 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120864.665135:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970584064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120864.665550:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970584192:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.665595:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.665629:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970584704:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.665667:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.665685:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970585216:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.665709:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.665731:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789120864.665737:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970584576:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.665757:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.665775:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970585088:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.665793:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.665842:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970584192 00000100:00100000:3.0:1789120864.665847:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970584192 00000100:00100000:3.0:1789120864.665886:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789120864.665907:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970584192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.665946:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970584192:12345-0@lo:400:kworker.0 Request processed in 40us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120864.665953:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789120864.666003:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970584704 00000100:00100000:3.0:1789120864.666007:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970584704 00000100:00100000:3.0:1789120864.666036:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789120864.666042:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970584704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.666077:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970584704:12345-0@lo:400:kworker.0 Request processed in 35us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120864.666084:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789120864.666102:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970585216 00000100:00100000:3.0:1789120864.666106:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970585216 00000100:00100000:3.0:1789120864.666274:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970584576 00000100:00100000:3.0:1789120864.666278:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970584576 00000100:00100000:3.0:1789120864.666297:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970585088 00000100:00100000:3.0:1789120864.666306:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970585088 00000100:00100000:3.0:1789120864.666329:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789120864.666336:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970585216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.666368:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970585216:12345-0@lo:400:kworker.0 Request processed in 33us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120864.666375:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789120864.666389:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789120864.666395:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970584576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.666423:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970584576:12345-0@lo:400:kworker.0 Request processed in 28us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120864.666429:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1789120864.666440:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789120864.666445:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970585088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.667443:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970585088:12345-0@lo:400:kworker.0 Request processed in 989us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120864.667455:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:3.0:1789120864.667518:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789120864.667524:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789120864.667542:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970584320:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.667594:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.667626:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970584832:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.667648:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.667665:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970585344:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.667690:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.667714:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789120864.667721:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970584448:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.667764:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.667782:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970584960:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.667803:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120864.667846:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970584320 00000100:00100000:3.0:1789120864.667852:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970584320 00000100:00100000:3.0:1789120864.667882:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970584832 00000100:00100000:3.0:1789120864.667884:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970584832 00000100:00100000:2.0:1789120864.668039:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970584960 00000100:00100000:2.0:1789120864.668044:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970584960 00000100:00100000:2.0:1789120864.668082:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789120864.668315:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789120864.668323:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf705a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970584960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.668425:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf705a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970584960:12345-0@lo:400:kworker.0 Request processed in 102us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120864.668432:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1789120864.668450:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00010000:00080000:1.0:1789120864.668643:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf7070c0 x1876028970584960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120864.668661:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970584960:0@lo:400:kworker.0 00000100:00100000:2.0:1789120864.668857:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf705e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970584320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120864.668921:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf705e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970584320:12345-0@lo:400:kworker.0 Request processed in 832us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120864.668928:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789120864.668955:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970585344 00000100:00100000:2.0:1789120864.668958:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970585344 00000100:00100000:2.0:1789120864.669010:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789120864.669018:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970585344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120864.669051:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970585344:12345-0@lo:400:kworker.0 Request processed in 34us (1360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120864.669057:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1789120864.669074:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120864.669087:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120864.669090:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789120864.673597:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970584320:0@lo:400:kworker.0 00010000:00080000:1.0:1789120864.673625:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf704f00 x1876028970585344/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120864.673639:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970585344:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.678271:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf705680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970584832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.678438:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970584448 00000100:00100000:3.0:1789120864.678449:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970584448 00000100:00100000:3.0:1789120864.678517:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789120864.678526:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970584448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.678652:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970584448:12345-0@lo:400:kworker.0 Request processed in 126us (10886us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120864.678660:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789120864.678725:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970584448:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.678777:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970584576:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.678794:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970585088:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.678807:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970584192:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.678875:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970584704:0@lo:400:kworker.0 00010000:00080000:3.0:1789120864.681006:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf706940 x1876028970585216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120880 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120864.681036:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970585216:0@lo:400:kworker.0 00000100:00100000:3.0:1789120864.683087:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf705680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970584832:12345-0@lo:400:kworker.0 Request processed in 14615us (15422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120864.683106:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1789120864.690526:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970584832:0@lo:400:kworker.0 00010000:00010000:2.0:1789120864.978218:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120865.174239:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970585472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789120865.174350:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120865.174863:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970585472 00000100:00100000:2.0:1789120865.174876:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970585472 00000100:00100000:2.0:1789120865.174962:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789120865.174974:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970585472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789120865.175017:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120865.175094:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970585472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120865.175103:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1789120865.175225:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b903c0 x1876028970585472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120865.175252:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970585472:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789120866.003738:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120867.030071:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120867.730138:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120867.730170:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970585600:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120867.730285:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120867.730385:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970585600 00000100:00100000:1.0:1789120867.730395:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970585600 00000100:00100000:1.0:1789120867.730470:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789120867.730804:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120867.730838:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970585728:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120867.730895:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120867.731123:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a089dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970585600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789120867.731173:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789120867.731283:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a089dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970585600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 165us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120867.731293:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789120867.731646:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970585728 00000100:00100000:1.0:1789120867.731653:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970585728 00000100:00100000:1.0:1789120867.731682:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789120867.731690:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970585728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789120867.731712:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120867.731755:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970585728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120867.731761:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789120867.736071:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b91e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970585728:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120867.736296:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970585600:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789120868.050231:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120869.077324:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789120869.297685:0:12011:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 06:01:07 (1789120867) === 00000100:00100000:3.0:1789120869.327009:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.327052:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.327080:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.327126:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947442432 00000100:00100000:3.0:1789120869.327138:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947442432 00000100:00100000:3.0:1789120869.327212:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947442304 00000100:00100000:3.0:1789120869.327215:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947442304 00000100:00100000:3.0:1789120869.327238:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:3.0:1789120869.327248:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947442432:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120869.327743:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:1.0:1789120869.327770:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947442304:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120869.327794:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947442432:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 543us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.327817:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:1.0:1789120869.327950:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947442304:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 180us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.328016:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947442176 00000100:00100000:0.0:1789120869.328022:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947442176 00000100:00100000:0.0:1789120869.328063:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 290 00000100:00100000:0.0:1789120869.328070:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2412:x1876028947442176:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120869.328117:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2412:x1876028947442176:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 47us (1131us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.328123:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 290 00000100:00080000:0.0:1789120869.329478:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120869.329488:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789120869.335450:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:1.0:1789120869.619222:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.619311:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947442560 00000100:00100000:3.0:1789120869.619324:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947442560 00000100:00100000:3.0:1789120869.619400:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 291 00000100:00100000:3.0:1789120869.619414:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+10:8755:x1876028947442560:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789120869.619458:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120869.619484:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887082e00/0xb74d2367a830f422 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e8ff expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120869.619528:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887082e00/0xb74d2367a830f422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8ff expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120869.619543:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887082e00/0xb74d2367a830f422 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8ff expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120869.619554:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082e00, rc 0) 00000100:00100000:3.0:1789120869.619698:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8755:x1876028947442560:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 286us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.619707:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 291 00000100:00100000:0.0:1789120869.630153:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.630265:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947442688 00000100:00100000:3.0:1789120869.630279:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947442688 00000100:00100000:3.0:1789120869.630351:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 292 00000100:00100000:3.0:1789120869.630364:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8755:x1876028947442688:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789120869.630603:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8755:x1876028947442688:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 240us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.630612:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 292 00000100:00100000:2.0:1789120869.633233:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.644735:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947442816 00000100:00100000:3.0:1789120869.644760:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947442816 00000100:00100000:3.0:1789120869.644879:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 293 00000100:00100000:3.0:1789120869.644893:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8755:x1876028947442816:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789120869.646223:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8755:x1876028947442816:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 1317us (12991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.646257:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 293 00000100:00100000:1.0:1789120869.657273:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120869.657414:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947442944 00000100:00100000:0.0:1789120869.657426:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947442944 00000100:00100000:0.0:1789120869.657504:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 294 00000100:00100000:0.0:1789120869.657517:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8759:x1876028947442944:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120869.657755:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8759:x1876028947442944:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 240us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.657764:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 294 00000100:00100000:2.0:1789120869.690782:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.691274:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947443072 00000100:00100000:3.0:1789120869.691288:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947443072 00000100:00100000:3.0:1789120869.691429:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 295 00000100:00100000:3.0:1789120869.691443:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8759:x1876028947443072:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789120869.691677:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8759:x1876028947443072:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 235us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.691686:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 295 00000100:00100000:2.0:1789120869.702636:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120869.702951:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947443200 00000100:00100000:1.0:1789120869.702964:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947443200 00000100:00100000:1.0:1789120869.703052:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 296 00000100:00100000:1.0:1789120869.703065:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8759:x1876028947443200:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789120869.703293:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8759:x1876028947443200:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 230us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120869.703303:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 296 00000100:00100000:1.0:1789120869.707399:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.707528:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947443328 00000100:00100000:3.0:1789120869.707541:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947443328 00000100:00100000:3.0:1789120869.707655:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 297 00000100:00100000:3.0:1789120869.707668:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+11:8755:x1876028947443328:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789120869.707694:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120869.707717:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887083200/0xb74d2367a830f429 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e930 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120869.707769:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887083200/0xb74d2367a830f429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e930 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120869.707784:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887083200/0xb74d2367a830f429 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e930 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120869.707797:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887083200, rc 0) 00000100:00100000:3.0:1789120869.708154:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:8755:x1876028947443328:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 486us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.708163:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 297 00000100:00100000:2.0:1789120869.710755:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120869.710915:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947443456 00000100:00100000:0.0:1789120869.711039:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947443456 00000100:00100000:0.0:1789120869.711184:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 298 00000100:00100000:0.0:1789120869.711199:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:8755:x1876028947443456:12345-192.168.202.32@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789120869.711244:0:6512:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789120869.711274:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789120869.711278:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789120869.711280:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789120869.711282:0:6512:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789120869.711284:0:6512:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:0.0:1789120869.712539:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:8755:x1876028947443456:12345-192.168.202.32@tcp:256:mount.lustre.0 Request processed in 1330us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.712552:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 298 00000100:00100000:1.0:1789120869.715406:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.715509:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947443584 00000100:00100000:3.0:1789120869.715525:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947443584 00000100:00100000:3.0:1789120869.715601:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 299 00000100:00100000:3.0:1789120869.715621:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:8755:x1876028947443584:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789120869.715649:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120869.715676:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946887083800/0xb74d2367a830f430 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e937 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120869.715718:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946887083800/0xb74d2367a830f430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e937 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120869.715730:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946887083800/0xb74d2367a830f430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e937 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120869.715741:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887083800, rc 0) 00000100:00100000:3.0:1789120869.716393:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:8755:x1876028947443584:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 775us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.716403:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 299 00000100:00100000:2.0:1789120869.719247:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120869.719372:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947443712 00000100:00100000:0.0:1789120869.719385:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947443712 00000100:00100000:0.0:1789120869.719513:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 300 00000100:00100000:0.0:1789120869.719526:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:8755:x1876028947443712:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789120869.719751:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:8755:x1876028947443712:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 227us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.719771:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 300 00000100:00100000:2.0:1789120869.721691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.721896:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947443840 00000100:00100000:3.0:1789120869.721907:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947443840 00000100:00100000:3.0:1789120869.722029:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 301 00000100:00100000:3.0:1789120869.722041:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:8755:x1876028947443840:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789120869.722232:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:8755:x1876028947443840:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 192us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.722241:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 301 00000100:00100000:2.0:1789120869.735486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120869.735612:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947443968 00000100:00100000:0.0:1789120869.735626:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947443968 00000100:00100000:0.0:1789120869.735703:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 302 00000100:00100000:0.0:1789120869.735736:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:8763:x1876028947443968:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120869.736027:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:8763:x1876028947443968:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 292us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.736037:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 302 00000100:00100000:2.0:1789120869.743038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.743172:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947444096 00000100:00100000:3.0:1789120869.743186:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947444096 00000100:00100000:3.0:1789120869.743300:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 303 00000100:00100000:3.0:1789120869.743332:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:8763:x1876028947444096:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789120869.743536:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:8763:x1876028947444096:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 206us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.743545:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 303 00000100:00100000:2.0:1789120869.750385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120869.750525:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.758377:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947444224 00000100:00100000:3.0:1789120869.758400:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947444224 00000100:00100000:0.0:1789120869.758525:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947444480 00000100:00100000:0.0:1789120869.758532:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947444480 00000100:00100000:0.0:1789120869.758633:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:0.0:1789120869.758645:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1876028947444480:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789120869.758695:0:11088:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 33ce8665-4f0b-4ca8-add3-a8f074595c87@192.168.202.32@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:0.0:1789120869.758752:0:11088:0:(genops.c:1385:class_connect()) connect: client 33ce8665-4f0b-4ca8-add3-a8f074595c87, cookie 0xb74d2367a830f437 00000004:00100000:0.0:1789120869.759200:0:11088:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789120869.759498:0:11088:0:(import.c:65:import_set_state_nolock()) ffff946783264000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789120869.759611:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b92940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2408:x1876028947444480:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 962us (9081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.759620:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:0.0:1789120869.759728:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:0.0:1789120869.759733:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1876028947444224:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789120869.759752:0:6520:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 33ce8665-4f0b-4ca8-add3-a8f074595c87@192.168.202.32@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:0.0:1789120869.759790:0:6520:0:(genops.c:1385:class_connect()) connect: client 33ce8665-4f0b-4ca8-add3-a8f074595c87, cookie 0xb74d2367a830f43e 00000004:00100000:0.0:1789120869.759817:0:6520:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789120869.759953:0:6520:0:(import.c:65:import_set_state_nolock()) ffff946783264800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789120869.759978:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b91e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2408:x1876028947444224:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 244us (9613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.759984:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:2.0:1789120869.772981:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120869.773032:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120869.773425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120869.775339:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947444608 00000100:00100000:3.0:1789120869.775357:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947444608 00000100:00100000:1.0:1789120869.775435:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947444352 00000100:00100000:1.0:1789120869.775440:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947444352 00000100:00100000:1.0:1789120869.775574:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947444736 00000100:00100000:1.0:1789120869.775578:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947444736 00000100:00100000:0.0:1789120869.775627:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:0.0:1789120869.775641:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+7:0:x1876028947444352:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789120869.775697:0:11088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00080000:2.0:1789120869.776494:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120869.776730:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b92580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+7:0:x1876028947444352:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 1086us (3690us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.776742:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:0.0:1789120869.777591:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:0.0:1789120869.777611:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:8755:x1876028947444736:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789120869.777649:0:11088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789120869.777708:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:8755:x1876028947444736:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 105us (4284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.777715:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:2.0:1789120869.778864:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:2.0:1789120869.778877:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:0:x1876028947444608:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789120869.778910:0:6518:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120869.779000:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b90f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:0:x1876028947444608:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 125us (6034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120869.779007:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00080000:3.0:1789120869.779456:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789120869.782444:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970585856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120869.782547:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120869.782637:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970586368:0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.782669:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120869.782687:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970586880:0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.782716:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120869.782733:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970587392:0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.782754:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120869.782795:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1789120869.782801:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970585984:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789120869.782994:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970585856 00000100:00100000:2.0:1789120869.783004:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970585856 00000100:00100000:2.0:1789120869.783105:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789120869.783119:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970585856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120869.783160:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120869.783215:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970585856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120869.783224:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789120869.783257:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970586880 00000100:00100000:2.0:1789120869.783261:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970586880 00000100:00100000:2.0:1789120869.783290:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970587392 00000100:00100000:2.0:1789120869.783293:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970587392 00000100:00100000:2.0:1789120869.783314:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789120869.783321:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970586880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120869.783357:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970586880:12345-0@lo:400:kworker.0 Request processed in 37us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120869.783364:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789120869.783375:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789120869.783380:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970587392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120869.783405:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970587392:12345-0@lo:400:kworker.0 Request processed in 26us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120869.783427:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789120869.783564:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120869.783603:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970586496:0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.783644:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120869.783665:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970587008:0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.783694:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120869.783715:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970587520:0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.783739:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789120869.783961:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70f0c0 x1876028970585856/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120869.783989:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970585856:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789120869.784005:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70f480 x1876028970586880/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120869.784017:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970586880:0@lo:400:kworker.0 00010000:00080000:0.0:1789120869.784028:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70fc00 x1876028970587392/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120869.784038:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970587392:0@lo:400:kworker.0 00000100:00100000:3.0:1789120869.784192:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970586112:0@lo:400:kworker.0 00000100:00100000:3.0:1789120869.784236:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120869.784265:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970586624:0@lo:400:kworker.0 00000100:00100000:3.0:1789120869.784291:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120869.784311:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970587136:0@lo:400:kworker.0 00000100:00100000:3.0:1789120869.784332:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120869.784352:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970587648:0@lo:400:kworker.0 00000100:00100000:3.0:1789120869.784376:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120869.784418:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970586368 00000100:00100000:3.0:1789120869.784424:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970586368 00000100:00100000:3.0:1789120869.784457:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970586624 00000100:00100000:3.0:1789120869.784460:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970586624 00000100:00100000:3.0:1789120869.784479:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789120869.784487:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970586368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120869.784540:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970586368:12345-0@lo:400:kworker.0 Request processed in 53us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.784548:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789120869.784580:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789120869.784586:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970586624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120869.784619:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970586624:12345-0@lo:400:kworker.0 Request processed in 34us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.784624:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789120869.784642:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970587008 00000100:00100000:3.0:1789120869.784645:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970587008 00000100:00100000:3.0:1789120869.784668:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970587520 00000100:00100000:3.0:1789120869.784671:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970587520 00000100:00100000:3.0:1789120869.784686:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970587136 00000100:00100000:3.0:1789120869.784688:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970587136 00000100:00100000:3.0:1789120869.784698:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970587648 00000100:00100000:3.0:1789120869.784699:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970587648 00000100:00100000:3.0:1789120869.784714:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789120869.784721:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970587008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120869.784754:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970587008:12345-0@lo:400:kworker.0 Request processed in 34us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120869.784956:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970585984 00000100:00100000:2.0:1789120869.784961:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970585984 00000100:00100000:2.0:1789120869.784990:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789120869.784998:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1876028970585984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789120869.785013:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120869.785050:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1876028970585984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120869.785056:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789120869.785173:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970586240:0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.785212:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120869.785233:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970586752:0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.785254:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120869.785265:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970587264:0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.785284:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120869.785315:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789120869.785324:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970587520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.785370:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970587520:12345-0@lo:400:kworker.0 Request processed in 48us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.785378:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789120869.785396:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789120869.785403:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970587136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.785431:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970587136:12345-0@lo:400:kworker.0 Request processed in 29us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.785438:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789120869.785451:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789120869.785456:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970587648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.785484:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7043c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970587648:12345-0@lo:400:kworker.0 Request processed in 28us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.785490:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789120869.785514:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970586496 00000100:00100000:0.0:1789120869.785518:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970586496 00000100:00100000:0.0:1789120869.785539:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970586240 00000100:00100000:0.0:1789120869.785542:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970586240 00000100:00100000:0.0:1789120869.785553:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970586752 00000100:00100000:0.0:1789120869.785555:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970586752 00000100:00100000:0.0:1789120869.785571:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970587264 00000100:00100000:0.0:1789120869.785573:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970587264 00000100:00100000:0.0:1789120869.785589:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789120869.785594:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970586496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.785625:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970586496:12345-0@lo:400:kworker.0 Request processed in 31us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.785632:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789120869.785644:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789120869.785657:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970586240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.785690:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970586240:12345-0@lo:400:kworker.0 Request processed in 34us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.785696:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789120869.785727:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970586240:0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.785750:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789120869.785756:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970586752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120869.785945:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1789120869.785987:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf7052c0 x1876028970585984/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120869.786005:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970585984:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120869.786017:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970586496:0@lo:400:kworker.0 00010000:00080000:3.0:1789120869.786027:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70de00 x1876028970587008/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120869.786034:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970587008:0@lo:400:kworker.0 00010000:00080000:3.0:1789120869.786044:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70da40 x1876028970587520/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120869.786059:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970587520:0@lo:400:kworker.0 00000100:00100000:3.0:1789120869.786072:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970586368:0@lo:400:kworker.0 00000100:00100000:2.0:1789120869.786210:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789120869.786221:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970587264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120869.786271:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970587264:12345-0@lo:400:kworker.0 Request processed in 53us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120869.786278:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1789120869.786353:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789120869.786360:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120869.786362:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120869.786365:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120869.786399:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970586624:0@lo:400:kworker.0 00010000:00080000:3.0:1789120869.786413:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70d680 x1876028970587136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120869.786423:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970587136:0@lo:400:kworker.0 00010000:00080000:3.0:1789120869.786435:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70c3c0 x1876028970587648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120885 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120869.786444:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970587648:0@lo:400:kworker.0 00000100:00100000:1.0:1789120869.786588:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970586112 00000100:00100000:1.0:1789120869.786594:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970586112 00000100:00100000:1.0:1789120869.786637:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789120869.786644:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970586112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120869.786688:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970586112:12345-0@lo:400:kworker.0 Request processed in 45us (2451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120869.786694:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789120869.786727:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970586112:0@lo:400:kworker.0 00000100:00100000:1.0:1789120869.786793:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970587264:0@lo:400:kworker.0 00000100:00100000:0.0:1789120869.788076:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970586752:12345-0@lo:400:kworker.0 Request processed in 2318us (2817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.788724:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789120869.789564:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970587776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120869.789642:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120869.789719:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970586752:0@lo:400:kworker.0 00000100:00100000:2.0:1789120869.789881:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970587776 00000100:00100000:2.0:1789120869.789890:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970587776 00000100:00100000:2.0:1789120869.789959:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789120869.789972:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970587776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120869.790008:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120869.790060:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf700000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970587776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120869.790067:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1789120869.790271:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70cb40 x1876028970587776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120885 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120869.790290:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970587776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120869.790689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120869.790780:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947444864 00000100:00100000:0.0:1789120869.790786:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947444864 00000100:00100000:3.0:1789120869.791032:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789120869.791044:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:8755:x1876028947444864:12345-192.168.202.32@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789120869.791198:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:8755:x1876028947444864:12345-192.168.202.32@tcp:40:mount.lustre.0 Request processed in 156us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.791205:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:2.0:1789120869.796490:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120869.796596:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120869.796640:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120869.796699:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120869.796719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120869.796741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120869.796782:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120869.796963:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947444992 00000100:00100000:2.0:1789120869.796976:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947444992 00000100:00100000:2.0:1789120869.797025:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947445120 00000100:00100000:2.0:1789120869.797029:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947445120 00000100:00100000:2.0:1789120869.797052:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:2.0:1789120869.797062:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2408:x1876028947444992:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789120869.797116:0:8433:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 33ce8665-4f0b-4ca8-add3-a8f074595c87@192.168.202.32@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:2.0:1789120869.797158:0:8433:0:(genops.c:1385:class_connect()) connect: client 33ce8665-4f0b-4ca8-add3-a8f074595c87, cookie 0xb74d2367a830f445 00002000:00100000:2.0:1789120869.797173:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 33ce8665-4f0b-4ca8-add3-a8f074595c87/ffff9467830a8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789120869.797187:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789120869.797304:0:8433:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789120869.797342:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9467830af000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789120869.797437:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2408:x1876028947444992:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 374us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120869.797446:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:2.0:1789120869.797466:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:2.0:1789120869.797471:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2408:x1876028947445120:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789120869.797490:0:8433:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 33ce8665-4f0b-4ca8-add3-a8f074595c87@192.168.202.32@tcp t0 exp 0000000000000000 cur 319 last 0 00000020:00000080:2.0:1789120869.797509:0:8433:0:(genops.c:1385:class_connect()) connect: client 33ce8665-4f0b-4ca8-add3-a8f074595c87, cookie 0xb74d2367a830f44c 00002000:00100000:2.0:1789120869.797514:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 33ce8665-4f0b-4ca8-add3-a8f074595c87/ffff9467830ab000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789120869.797521:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789120869.797573:0:8433:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789120869.797589:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9467830ae800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789120869.797614:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2408:x1876028947445120:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 141us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120869.797621:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:0.0:1789120869.798799:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947445632 00000100:00100000:0.0:1789120869.798812:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947445632 00000100:00100000:0.0:1789120869.798916:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947445504 00000100:00100000:0.0:1789120869.798920:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947445504 00000100:00100000:0.0:1789120869.798950:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947445760 00000100:00100000:0.0:1789120869.798954:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947445760 00000100:00100000:0.0:1789120869.798978:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 132 00000100:00100000:0.0:1789120869.798987:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947445632:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120869.799045:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947445632:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 59us (2404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.799052:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 132 00000100:00100000:0.0:1789120869.799069:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 133 00000100:00100000:0.0:1789120869.799074:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947445504:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120869.799276:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947445504:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 200us (2576us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.799298:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 133 00000100:00100000:0.0:1789120869.799311:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:0.0:1789120869.799317:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2411:x1876028947445760:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120869.799341:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2411:x1876028947445760:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (2622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120869.799346:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:1.0:1789120869.799538:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947445376 00000100:00100000:1.0:1789120869.799544:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947445376 00000100:00100000:1.0:1789120869.799582:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 305 00000100:00100000:1.0:1789120869.799589:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947445376:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120869.799616:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947445376:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 28us (3020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120869.799622:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 305 00000100:00100000:3.0:1789120869.802185:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947445248 00000100:00100000:3.0:1789120869.802201:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947445248 00000100:00100000:3.0:1789120869.802499:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:3.0:1789120869.802513:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:8755:x1876028947445248:12345-192.168.202.32@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789120869.802656:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:8755:x1876028947445248:12345-192.168.202.32@tcp:900:mount.lustre.0 Request processed in 146us (6183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120869.802665:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:2.0:1789120869.804970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120869.805150:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947445888 00000100:00100000:1.0:1789120869.805163:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947445888 00000100:00100000:1.0:1789120869.805277:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:1.0:1789120869.805291:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:8755:x1876028947445888:12345-192.168.202.32@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789120869.805419:0:6521:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789120869.805579:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:8755:x1876028947445888:12345-192.168.202.32@tcp:33:mount.lustre.0 Request processed in 291us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120869.805588:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00010000:00010000:1.0:1789120870.098371:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120870.291440:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120870.291476:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970587904:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789120870.291581:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120870.293509:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970587904 00000100:00100000:2.0:1789120870.293527:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970587904 00000100:00100000:2.0:1789120870.293622:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789120870.293634:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970587904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789120870.293676:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120870.293793:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970587904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 160us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120870.293801:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:1.0:1789120870.294097:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70ed00 x1876028970587904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120870.294122:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970587904:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789120871.122205:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120872.152172:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120872.855879:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120872.855898:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970588032:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120872.855992:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120872.856022:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970588160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789120872.856052:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120872.856062:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970588032 00000100:00100000:0.0:1789120872.856070:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970588032 00000100:00100000:0.0:1789120872.856113:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970588160 00000100:00100000:0.0:1789120872.856116:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970588160 00000100:00100000:0.0:1789120872.856134:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789120872.856143:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970588032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789120872.856330:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789120872.856420:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970588032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 277us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120872.856428:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789120872.856443:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789120872.856451:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970588160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789120872.856469:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789120872.856509:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970588160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120872.856516:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789120872.856597:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970588032:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120872.856611:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970588160:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789120873.171204:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120874.194742:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120874.898358:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970588416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120874.898790:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120874.899194:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970588416 00000100:00100000:2.0:1789120874.899202:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970588416 00000100:00100000:2.0:1789120874.899381:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789120874.899392:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970588416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120874.899421:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120874.899468:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970588416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120874.899485:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789120874.899509:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970588544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120874.899536:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789120874.899585:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70d2c0 x1876028970588416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120874.899603:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970588416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120874.899626:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970588544 00000100:00100000:2.0:1789120874.899629:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970588544 00000100:00100000:2.0:1789120874.899649:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789120874.899655:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970588544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120874.899671:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120874.899703:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970588544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120874.899711:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:2.0:1789120874.899734:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70fc00 x1876028970588544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120874.899748:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970588544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120874.899781:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120874.899789:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970588288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789120874.899813:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120874.900033:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970588288 00000100:00100000:2.0:1789120874.900037:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970588288 00000100:00100000:2.0:1789120874.900058:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789120874.900064:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970588288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789120874.900084:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120874.900115:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970588288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120874.900121:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:2.0:1789120874.900146:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf704f00 x1876028970588288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120890 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120874.900160:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970588288:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789120874.900186:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120874.900190:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120874.901636:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970588800:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.901698:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120874.901730:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970589312:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.901754:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120874.901771:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970589824:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.901797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120874.901851:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789120874.901858:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970588672:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.901900:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120874.901933:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970589184:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.901956:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120874.901971:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970589696:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.901989:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120874.902013:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970588800 00000100:00100000:0.0:1789120874.902021:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970588800 00000100:00100000:0.0:1789120874.902059:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970589312 00000100:00100000:0.0:1789120874.902062:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970589312 00000100:00100000:0.0:1789120874.902086:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970589696 00000100:00100000:0.0:1789120874.902088:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970589696 00000100:00100000:0.0:1789120874.902103:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789120874.902111:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970588800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.902159:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfa940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970588800:12345-0@lo:400:kworker.0 Request processed in 48us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120874.902166:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789120874.902181:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789120874.902187:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970589312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.902222:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970589312:12345-0@lo:400:kworker.0 Request processed in 36us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120874.902228:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789120874.902652:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789120874.902662:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970589696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.902693:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970589696:12345-0@lo:400:kworker.0 Request processed in 35us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120874.902699:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789120874.902724:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970589824 00000100:00100000:0.0:1789120874.902727:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970589824 00000100:00100000:0.0:1789120874.902757:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789120874.902763:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970589824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.902792:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970589824:12345-0@lo:400:kworker.0 Request processed in 29us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120874.902797:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789120874.902815:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970589184 00000100:00100000:0.0:1789120874.902837:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970589184 00000100:00100000:0.0:1789120874.902862:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789120874.902868:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970589184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.902915:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970589184:12345-0@lo:400:kworker.0 Request processed in 47us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120874.902921:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789120874.902970:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970589184:0@lo:400:kworker.0 00010000:00080000:0.0:1789120874.902982:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783cf9a40 x1876028970589696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120874.903007:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970589696:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.903020:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ee940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970588800:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.903029:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970589312:0@lo:400:kworker.0 00010000:00080000:0.0:1789120874.903037:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783cf8b40 x1876028970589824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120874.903045:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970589824:0@lo:400:kworker.0 00000100:00080000:0.0:1789120874.903072:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120874.903077:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789120874.903079:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120874.903090:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970589056:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.903117:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120874.903137:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970589568:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.903156:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120874.903173:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789120874.903178:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970588928:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.903201:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120874.903217:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970589440:0@lo:400:kworker.0 00000100:00100000:2.0:1789120874.903435:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970588672 00000100:00100000:2.0:1789120874.903440:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970588672 00000100:00100000:2.0:1789120874.903471:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789120874.903477:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970588672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120874.903514:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970588672:12345-0@lo:400:kworker.0 Request processed in 38us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120874.903520:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1789120874.903636:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120874.903674:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970589056 00000100:00100000:0.0:1789120874.903678:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970589056 00000100:00100000:0.0:1789120874.903700:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970589568 00000100:00100000:0.0:1789120874.903702:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970589568 00000100:00100000:0.0:1789120874.903719:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970589440 00000100:00100000:0.0:1789120874.903722:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970589440 00000100:00100000:0.0:1789120874.903745:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789120874.903750:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970589056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.903785:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970589056:12345-0@lo:400:kworker.0 Request processed in 35us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120874.903791:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789120874.903802:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789120874.903808:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970589568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.903855:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970589568:12345-0@lo:400:kworker.0 Request processed in 48us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120874.903861:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789120874.903871:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789120874.903876:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970589440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.903909:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970589440:12345-0@lo:400:kworker.0 Request processed in 33us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120874.903914:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789120874.903930:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970588928 00000100:00100000:0.0:1789120874.903933:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970588928 00000100:00100000:0.0:1789120874.903950:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789120874.903956:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970588928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.903983:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970588928:12345-0@lo:400:kworker.0 Request processed in 28us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120874.903989:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1789120874.904009:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789120874.904012:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120874.904030:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970588672:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.904061:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970588928:0@lo:400:kworker.0 00010000:00080000:0.0:1789120874.904080:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839eed00 x1876028970589440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120890 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120874.904089:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970589440:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.904099:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970589056:0@lo:400:kworker.0 00000100:00100000:0.0:1789120874.904107:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970589568:0@lo:400:kworker.0 00000100:00100000:2.0:1789120874.958637:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120874.959735:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947446016 00000100:00100000:3.0:1789120874.959746:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947446016 00000100:00100000:3.0:1789120874.959811:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 307 00000100:00100000:3.0:1789120874.959840:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947446016:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120874.959849:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120874.959895:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947446144 00000100:00100000:2.0:1789120874.959900:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947446144 00000100:00100000:3.0:1789120874.959924:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947446016:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 104us (1298us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120874.959931:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 307 00000100:00100000:2.0:1789120874.959957:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 141 00000100:00100000:2.0:1789120874.959975:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947446144:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120874.960009:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947446144:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 43us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120874.960015:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 141 00000100:00080000:0.0:1789120874.960184:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120874.961469:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120874.961527:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120874.961549:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120874.961571:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120874.961621:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120874.961644:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947446400 00000100:00100000:2.0:1789120874.961650:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947446656 00000100:00100000:3.0:1789120874.961653:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947446400 00000100:00100000:2.0:1789120874.961657:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947446656 00000100:00100000:3.0:1789120874.961714:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947446272 00000100:00100000:3.0:1789120874.961719:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947446272 00000100:00100000:2.0:1789120874.961719:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947446784 00000100:00100000:2.0:1789120874.961725:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947446784 00000100:00100000:3.0:1789120874.961747:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947446528 00000100:00100000:3.0:1789120874.961751:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947446528 00000100:00100000:2.0:1789120874.961767:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:3.0:1789120874.961774:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 142 00000100:00100000:2.0:1789120874.961780:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947446656:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120874.961788:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947446400:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120874.961859:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947446656:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120874.961867:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:2.0:1789120874.961883:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:2.0:1789120874.961902:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893846580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947446784:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120874.962128:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947446400:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 344us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120874.962137:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 142 00000100:00100000:3.0:1789120874.962153:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 143 00000100:00100000:3.0:1789120874.962159:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947446272:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120874.962181:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947446272:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 23us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120874.962194:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 143 00000100:00100000:3.0:1789120874.962205:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 144 00000100:00100000:3.0:1789120874.962211:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893847c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947446528:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120874.962233:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893847c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947446528:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 22us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120874.962237:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 144 00000100:00080000:3.0:1789120874.962253:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120874.962257:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120874.962259:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789120874.962262:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120874.962347:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893846580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947446784:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 455us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120874.962354:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00010000:00010000:3.0:1789120875.217982:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120875.410107:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120875.410134:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893845a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970589952:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789120875.410207:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120875.410915:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970589952 00000100:00100000:2.0:1789120875.410923:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970589952 00000100:00100000:2.0:1789120875.411007:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789120875.411017:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970589952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789120875.411042:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120875.411104:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf703480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970589952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120875.411112:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:1.0:1789120875.411200:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893845a40 x1876028970589952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120875.411218:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893845a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970589952:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1789120875.469268:0:12204:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-client.virtnet: executing check_config_client /mnt/lustre 00000001:00100000:3.0:1789120875.926754:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 33ce8665-4f0b-4ca8-add3-a8f074595c87 00000001:00100000:1.0:1789120875.927095:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 33ce8665-4f0b-4ca8-add3-a8f074595c87 00000001:00100000:2.0:1789120875.927719:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 33ce8665-4f0b-4ca8-add3-a8f074595c87 00000001:00100000:0.0:1789120875.927946:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 33ce8665-4f0b-4ca8-add3-a8f074595c87 00010000:00010000:1.0:1789120876.254904:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120877.265985:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120877.970326:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120877.970358:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970590080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120877.970457:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120877.970582:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970590080 00000100:00100000:1.0:1789120877.970591:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970590080 00000100:00100000:1.0:1789120877.970650:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789120877.970660:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970590080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789120877.970704:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120877.970756:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970590080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120877.970901:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789120877.971196:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970590080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120877.971214:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120877.971227:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893845680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970590208:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789120877.971268:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120877.971311:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970590208 00000100:00100000:3.0:1789120877.971316:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970590208 00000100:00100000:3.0:1789120877.971354:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789120877.971362:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893845a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970590208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120877.971391:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789120877.972105:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893845a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970590208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 740us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120877.972116:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789120877.974315:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893845680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970590208:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789120878.291466:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120879.314083:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120880.018086:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970590464:0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.018160:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120880.018211:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970590976:0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.018233:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120880.018256:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970591488:0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.018279:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120880.018305:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789120880.018312:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970590592:0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.018338:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120880.018354:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970591104:0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.018375:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120880.018391:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970591616:0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.018412:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120880.018442:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970590464 00000100:00100000:0.0:1789120880.018449:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970590464 00000100:00100000:0.0:1789120880.018513:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970590976 00000100:00100000:0.0:1789120880.018516:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970590976 00000100:00100000:0.0:1789120880.018538:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970591488 00000100:00100000:0.0:1789120880.018541:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970591488 00000100:00100000:0.0:1789120880.018552:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970591104 00000100:00100000:0.0:1789120880.018554:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970591104 00000100:00100000:0.0:1789120880.018566:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970591616 00000100:00100000:0.0:1789120880.018569:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970591616 00000100:00100000:0.0:1789120880.018586:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789120880.018596:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970590464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.018654:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970590464:12345-0@lo:400:kworker.0 Request processed in 59us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120880.018661:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789120880.018679:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789120880.018685:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970590976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.018713:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970590976:12345-0@lo:400:kworker.0 Request processed in 28us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120880.018718:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789120880.018729:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789120880.018734:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970591488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.018760:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970591488:12345-0@lo:400:kworker.0 Request processed in 25us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120880.018765:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789120880.018774:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789120880.018780:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970591104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.018804:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970591104:12345-0@lo:400:kworker.0 Request processed in 24us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120880.018863:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789120880.018877:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789120880.018883:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946889573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970591616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.018912:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946889573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970591616:12345-0@lo:400:kworker.0 Request processed in 30us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120880.018918:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00010000:00080000:0.0:1789120880.018961:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b070c0 x1876028970591104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120880.018975:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970591104:0@lo:400:kworker.0 00010000:00080000:0.0:1789120880.018985:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf64f480 x1876028970591616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120880.018993:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970591616:0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.019003:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970590464:0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.019011:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970590976:0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.019021:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970591488:0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019112:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970590336:0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019152:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120880.019186:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970590848:0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120880.019226:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970591360:0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019248:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120880.019266:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970591872:0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019288:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120880.019308:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789120880.019314:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970590720:0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019335:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120880.019352:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970591232:0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019370:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120880.019385:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970591744:0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019406:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120880.019432:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970590720 00000100:00100000:3.0:1789120880.019436:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970590720 00000100:00100000:3.0:1789120880.019465:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789120880.019472:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970590720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019509:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970590720:12345-0@lo:400:kworker.0 Request processed in 37us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120880.019516:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789120880.019542:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970590592 00000100:00100000:3.0:1789120880.019545:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970590592 00000100:00100000:3.0:1789120880.019562:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970590848 00000100:00100000:3.0:1789120880.019565:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970590848 00000100:00100000:3.0:1789120880.019579:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789120880.019592:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970590592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019633:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970590592:12345-0@lo:400:kworker.0 Request processed in 42us (1295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120880.019640:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789120880.019653:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789120880.019658:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970590848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019682:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970590848:12345-0@lo:400:kworker.0 Request processed in 24us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120880.019688:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1789120880.019703:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120880.019706:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120880.019717:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970591360 00000100:00100000:3.0:1789120880.019721:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970591360 00000100:00100000:3.0:1789120880.019744:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970591872 00000100:00100000:3.0:1789120880.019747:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970591872 00000100:00100000:3.0:1789120880.019757:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970591232 00000100:00100000:3.0:1789120880.019759:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970591232 00000100:00100000:3.0:1789120880.019769:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970591744 00000100:00100000:3.0:1789120880.019771:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970591744 00000100:00100000:3.0:1789120880.019782:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789120880.019788:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970591360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019817:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970591360:12345-0@lo:400:kworker.0 Request processed in 29us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120880.019867:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789120880.019880:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789120880.019886:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970591872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019911:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970591872:12345-0@lo:400:kworker.0 Request processed in 26us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120880.019926:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789120880.019939:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789120880.019945:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970591232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.019973:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970591232:12345-0@lo:400:kworker.0 Request processed in 28us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120880.019979:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789120880.019990:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789120880.019995:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970591744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.020021:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970591744:12345-0@lo:400:kworker.0 Request processed in 25us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120880.020026:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789120880.020063:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970590720:0@lo:400:kworker.0 00010000:00080000:3.0:1789120880.020088:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b05e00 x1876028970591232/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120880.020099:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970591232:0@lo:400:kworker.0 00010000:00080000:3.0:1789120880.020109:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf64c780 x1876028970591744/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120880.020118:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970591744:0@lo:400:kworker.0 00000100:00100000:3.0:1789120880.020126:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ec780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970590848:0@lo:400:kworker.0 00010000:00080000:3.0:1789120880.020135:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b07c00 x1876028970591360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120880.020144:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b07c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970591360:0@lo:400:kworker.0 00010000:00080000:3.0:1789120880.020164:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf64e940 x1876028970591872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120880.020173:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970591872:0@lo:400:kworker.0 00000100:00080000:3.0:1789120880.020198:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120880.020200:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120880.020224:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970590592:0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.020730:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970590336 00000100:00100000:0.0:1789120880.020736:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970590336 00000100:00100000:0.0:1789120880.020767:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789120880.020774:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970590336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120880.020817:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970590336:12345-0@lo:400:kworker.0 Request processed in 44us (1664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120880.020849:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1789120880.021015:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970590336:0@lo:400:kworker.0 00000100:00100000:1.0:1789120880.025099:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120880.025123:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970592000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120880.025205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120880.025253:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970592000 00000100:00100000:1.0:1789120880.025260:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970592000 00000100:00100000:1.0:1789120880.025312:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789120880.025321:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970592000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120880.025357:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120880.025403:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970592000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120880.025410:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1789120880.025455:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70da40 x1876028970592000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120880.025476:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970592000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120880.025668:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120880.025678:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970592128:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120880.025712:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120880.025736:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970592128 00000100:00100000:3.0:1789120880.025740:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970592128 00000100:00100000:3.0:1789120880.025761:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789120880.025768:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970592128:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120880.025779:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120880.025807:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970592128:12345-0@lo:13:osp-pre-0-1.0 Request processed in 39us (94us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120880.025814:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:3.0:1789120880.025878:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467831f8b40 x1876028970592128/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120880.025891:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970592128:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120880.026161:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970592256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120880.026193:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120880.026227:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970592256 00000100:00100000:0.0:1789120880.026231:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970592256 00000100:00100000:0.0:1789120880.026255:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789120880.026261:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970592256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120880.026280:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120880.026310:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1cc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970592256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120880.026316:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1789120880.026527:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783cfb480 x1876028970592256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120880.026541:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970592256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120880.093627:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120880.093663:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120880.093686:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120880.093711:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120880.093728:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120880.093745:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120880.093764:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120880.093790:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947447040 00000100:00100000:2.0:1789120880.093800:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947447040 00000100:00100000:2.0:1789120880.093905:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947447296 00000100:00100000:2.0:1789120880.093909:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947447296 00000100:00100000:2.0:1789120880.093920:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947447168 00000100:00100000:2.0:1789120880.093923:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947447168 00000100:00100000:2.0:1789120880.093935:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947447424 00000100:00100000:2.0:1789120880.093938:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947447424 00000100:00100000:2.0:1789120880.093954:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 151 00000100:00100000:2.0:1789120880.093963:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893845680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947447040:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120880.094034:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893845680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947447040:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 71us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120880.094042:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 151 00000100:00100000:2.0:1789120880.094058:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 152 00000100:00100000:2.0:1789120880.094064:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947447296:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120880.094101:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947447296:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 37us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120880.094108:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 152 00000100:00100000:2.0:1789120880.094119:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 153 00000100:00100000:2.0:1789120880.094125:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947447168:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120880.094145:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947447168:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 20us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120880.094151:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 153 00000100:00100000:2.0:1789120880.094161:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 154 00000100:00100000:2.0:1789120880.094166:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947447424:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120880.094185:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947447424:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 19us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120880.094191:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 154 00000100:00100000:2.0:1789120880.094211:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947446912 00000100:00100000:2.0:1789120880.094215:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947446912 00000100:00100000:2.0:1789120880.094238:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 309 00000100:00100000:2.0:1789120880.094244:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947446912:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120880.094268:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947446912:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120880.094274:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 309 00000100:00100000:2.0:1789120880.094436:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947447552 00000100:00100000:2.0:1789120880.094440:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947447552 00000100:00100000:2.0:1789120880.094466:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947447680 00000100:00100000:2.0:1789120880.094469:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947447680 00000100:00100000:2.0:1789120880.094489:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:2.0:1789120880.094503:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947447552:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120880.094535:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b1680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947447552:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 34us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120880.094542:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:2.0:1789120880.094553:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:2.0:1789120880.094559:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947447680:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120880.094582:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947447680:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 23us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120880.094588:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00080000:2.0:1789120880.094628:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120880.094632:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120880.094634:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789120880.094636:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789120880.338065:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120880.533550:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970592384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789120880.533624:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120880.533679:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970592384 00000100:00100000:3.0:1789120880.533688:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970592384 00000100:00100000:3.0:1789120880.533754:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789120880.533765:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970592384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789120880.533797:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120880.533898:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970592384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 134us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120880.533906:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:0.0:1789120880.533948:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf74a940 x1876028970592384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120880.533967:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970592384:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789120881.363002:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120882.391365:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789120882.858264:0:12520:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789120882.858553:0:12520:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1789120883.095487:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970592512:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120883.098884:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970592640:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120883.099593:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120883.099667:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970592640 00000100:00100000:2.0:1789120883.099675:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970592640 00000100:00100000:2.0:1789120883.099726:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789120883.099736:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970592640:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789120883.099771:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120883.099860:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970592640:12345-0@lo:41:osp-pre-1-0.0 Request processed in 125us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120883.099868:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789120883.099942:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970592640:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120883.101245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120883.101298:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970592512 00000100:00100000:1.0:1789120883.101305:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970592512 00000100:00100000:1.0:1789120883.101382:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789120883.101387:0:6523:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789120883.101391:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970592512:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789120883.101395:0:6523:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000004:00000024:1.0:1789120883.101420:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789120883.101762:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970592512:12345-0@lo:41:osp-pre-0-1.0 Request processed in 372us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120883.101770:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789120883.106431:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c38f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970592512:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789120883.410043:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120884.435677:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789120884.893206:0:12618:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789120884.893513:0:12618:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789120885.138119:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120885.138145:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970592768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789120885.138456:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120885.138542:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970592896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120885.138566:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120885.138648:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970592768 00000100:00100000:3.0:1789120885.138656:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970592768 00000100:00100000:3.0:1789120885.138716:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970592896 00000100:00100000:3.0:1789120885.138719:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970592896 00000100:00100000:3.0:1789120885.138736:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789120885.138744:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970592768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120885.138773:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120885.138852:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970592768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 108us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120885.138860:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789120885.138878:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789120885.138883:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970592896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120885.138892:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120885.138915:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970592896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 32us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120885.138921:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:3.0:1789120885.138953:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b9c39680 x1876028970592896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120885.138987:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c39680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970592896:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1789120885.138999:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468938eb480 x1876028970592768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120885.139009:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970592768:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789120885.139212:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120885.139866:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970593280:0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.139964:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120885.139993:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970593792:0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140012:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120885.140026:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970594304:0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140045:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120885.140063:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789120885.140067:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970593408:0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140088:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120885.140102:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970593920:0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140118:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120885.140130:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970594432:0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140148:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120885.140182:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970593280 00000100:00100000:3.0:1789120885.140186:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970593280 00000100:00100000:3.0:1789120885.140218:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970593792 00000100:00100000:3.0:1789120885.140221:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970593792 00000100:00100000:3.0:1789120885.140244:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970593920 00000100:00100000:3.0:1789120885.140261:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970593920 00000100:00100000:3.0:1789120885.140281:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789120885.140299:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970593280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140341:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970593280:12345-0@lo:400:kworker.0 Request processed in 43us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120885.140348:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789120885.140366:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789120885.140371:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970593792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140394:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970593792:12345-0@lo:400:kworker.0 Request processed in 23us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120885.140399:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789120885.140409:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789120885.140414:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970593920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140437:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970593920:12345-0@lo:400:kworker.0 Request processed in 23us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120885.140441:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789120885.140463:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970594304 00000100:00100000:3.0:1789120885.140466:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970594304 00000100:00100000:3.0:1789120885.140489:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970594432 00000100:00100000:3.0:1789120885.140492:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970594432 00000100:00100000:3.0:1789120885.140507:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789120885.140512:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970594304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140540:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970594304:12345-0@lo:400:kworker.0 Request processed in 28us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120885.140547:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789120885.140557:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789120885.140562:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970594432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140583:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970594432:12345-0@lo:400:kworker.0 Request processed in 21us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120885.140594:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789120885.140612:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970593408 00000100:00100000:3.0:1789120885.140615:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970593408 00000100:00100000:3.0:1789120885.140636:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1789120885.140642:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970593408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140671:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970593408:12345-0@lo:400:kworker.0 Request processed in 30us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120885.140677:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:3.0:1789120885.140712:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120885.140716:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120885.140718:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120885.140743:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970593408:0@lo:400:kworker.0 00010000:00080000:3.0:1789120885.140754:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467831fad00 x1876028970593920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120885.140764:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970593920:0@lo:400:kworker.0 00010000:00080000:3.0:1789120885.140774:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467831f8000 x1876028970594432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120885.140782:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970594432:0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140806:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970593280:0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.140816:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970593792:0@lo:400:kworker.0 00010000:00080000:3.0:1789120885.140853:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467831fb0c0 x1876028970594304/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120885.140861:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970594304:0@lo:400:kworker.0 00000100:00100000:1.0:1789120885.141237:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970593152:0@lo:400:kworker.0 00000100:00100000:1.0:1789120885.141300:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120885.141337:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970593664:0@lo:400:kworker.0 00000100:00100000:1.0:1789120885.141362:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120885.141388:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970594176:0@lo:400:kworker.0 00000100:00100000:1.0:1789120885.141413:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120885.141436:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789120885.141442:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970593024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120885.141467:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120885.141486:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970593536:0@lo:400:kworker.0 00000100:00100000:1.0:1789120885.141507:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120885.141521:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970594048:0@lo:400:kworker.0 00000100:00100000:1.0:1789120885.141541:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120885.141566:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970594176 00000100:00100000:1.0:1789120885.141570:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970594176 00000100:00100000:1.0:1789120885.141600:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970593536 00000100:00100000:1.0:1789120885.141603:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970593536 00000100:00100000:1.0:1789120885.141627:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970594048 00000100:00100000:1.0:1789120885.141630:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970594048 00000100:00100000:1.0:1789120885.141647:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789120885.141654:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf707840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970594176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120885.141802:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970593664 00000100:00100000:2.0:1789120885.141813:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970593664 00000100:00100000:2.0:1789120885.141867:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789120885.141874:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970593664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120885.141907:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970593664:12345-0@lo:400:kworker.0 Request processed in 34us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120885.141914:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789120885.142263:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf707840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970594176:12345-0@lo:400:kworker.0 Request processed in 38us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120885.142272:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789120885.142290:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789120885.142296:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970593536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120885.142328:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970593536:12345-0@lo:400:kworker.0 Request processed in 34us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120885.142335:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789120885.142344:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789120885.142350:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970594048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120885.142373:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970594048:12345-0@lo:400:kworker.0 Request processed in 24us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120885.142378:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789120885.142410:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970593536:0@lo:400:kworker.0 00000100:00100000:1.0:1789120885.142421:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970594048:0@lo:400:kworker.0 00000100:00100000:1.0:1789120885.142431:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970593664:0@lo:400:kworker.0 00010000:00080000:1.0:1789120885.142442:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467831f9a40 x1876028970594176/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120885.142451:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970594176:0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.142678:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970593152 00000100:00100000:3.0:1789120885.142683:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970593152 00000100:00080000:0.0:1789120885.142929:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120885.142934:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789120885.142949:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970593024 00000100:00100000:0.0:1789120885.142954:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970593024 00000100:00100000:0.0:1789120885.142995:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789120885.143004:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970593024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120885.143049:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120885.143108:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970593024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120885.143115:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:0.0:1789120885.143147:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b9c3ad00 x1876028970593024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120885.143164:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970593024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120885.143814:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789120885.143841:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970593152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.143953:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970593152:12345-0@lo:400:kworker.0 Request processed in 130us (2652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120885.143960:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789120885.145688:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970593152:0@lo:400:kworker.0 00000100:00100000:3.0:1789120885.200235:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120885.200289:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120885.200380:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947447808 00000100:00100000:0.0:1789120885.200393:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947447808 00000100:00100000:0.0:1789120885.200479:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 311 00000100:00100000:0.0:1789120885.200491:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947447808:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120885.200592:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947447808:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 103us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120885.200600:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 311 00000100:00100000:1.0:1789120885.201137:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947447936 00000100:00100000:1.0:1789120885.201161:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947447936 00000100:00100000:1.0:1789120885.201231:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 161 00000100:00100000:1.0:1789120885.201241:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947447936:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120885.201294:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947447936:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 55us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120885.201302:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 161 00000100:00080000:0.0:1789120885.201395:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120885.206892:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120885.206937:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120885.206962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120885.206991:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120885.207021:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120885.207060:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947448064 00000100:00100000:2.0:1789120885.207073:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947448064 00000100:00100000:2.0:1789120885.207163:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947448192 00000100:00100000:2.0:1789120885.207167:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947448192 00000100:00100000:2.0:1789120885.207193:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947448320 00000100:00100000:2.0:1789120885.207195:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947448320 00000100:00100000:2.0:1789120885.207218:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 162 00000100:00100000:2.0:1789120885.207231:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947448064:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120885.207338:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947448064:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 109us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120885.207347:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 162 00000100:00100000:2.0:1789120885.207366:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 163 00000100:00100000:2.0:1789120885.207372:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947448192:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120885.207401:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947448192:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 28us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120885.207407:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 163 00000100:00100000:2.0:1789120885.207443:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 164 00000100:00100000:2.0:1789120885.207449:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947448320:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120885.207476:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947448320:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 26us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120885.207482:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 164 00000100:00100000:2.0:1789120885.207523:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947448576 00000100:00100000:2.0:1789120885.207527:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947448576 00000100:00100000:2.0:1789120885.207559:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947448448 00000100:00100000:2.0:1789120885.207562:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947448448 00000100:00100000:2.0:1789120885.207586:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:2.0:1789120885.207592:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947448576:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120885.207620:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947448576:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 28us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120885.207627:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00080000:1.0:1789120885.207868:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120885.207874:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120885.207877:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120885.207879:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789120885.207932:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:2.0:1789120885.207942:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947448448:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120885.207970:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947448448:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 31us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120885.210900:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 61 00010000:00010000:3.0:1789120885.459058:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120885.652067:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789120885.653084:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970594560:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789120885.653191:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120885.656624:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970594560 00000100:00100000:0.0:1789120885.656644:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970594560 00000100:00100000:0.0:1789120885.656724:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789120885.656736:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970594560:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120885.656773:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120885.657201:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970594560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 463us (4007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120885.657211:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:2.0:1789120885.657424:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70da40 x1876028970594560/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120885.657450:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970594560:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789120886.483287:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789120886.866063:0:12715:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789120886.866384:0:12715:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789120887.506215:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120888.211299:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120888.211325:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970594688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120888.211397:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120888.211497:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970594688 00000100:00100000:2.0:1789120888.211505:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970594688 00000100:00100000:2.0:1789120888.211564:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789120888.211575:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970594688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789120888.211612:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120888.211669:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970594688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120888.211676:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789120888.211807:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120888.211842:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970594816:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120888.211848:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970594688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120888.211882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120888.211906:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970594816 00000100:00100000:1.0:1789120888.211911:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970594816 00000100:00100000:1.0:1789120888.211938:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789120888.211945:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970594816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789120888.211963:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789120888.212031:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970594816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120888.212037:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789120888.212073:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970594816:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789120888.531231:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789120889.367621:0:12813:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789120889.368085:0:12813:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789120889.555548:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120890.258090:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970594944:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.258171:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.258853:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970595456:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.258890:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.258915:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970595968:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.258941:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.258960:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970596480:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.258981:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.259008:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789120890.259014:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970595328:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259037:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.259054:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970595840:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259074:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.259106:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970596352:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259129:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.259160:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970595072:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259183:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.259200:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970595584:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259218:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.259232:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970596096:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259267:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.259285:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970596608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120890.259308:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.259328:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789120890.259334:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970595200:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259368:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.259386:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970595712:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259408:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.259423:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970596224:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259441:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.259470:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970594944 00000100:00100000:3.0:1789120890.259476:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970594944 00000100:00100000:3.0:1789120890.259515:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789120890.259523:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970594944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259571:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970594944:12345-0@lo:400:kworker.0 Request processed in 48us (1400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.259579:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789120890.259612:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970595968 00000100:00100000:3.0:1789120890.259622:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970595968 00000100:00100000:3.0:1789120890.259647:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970596480 00000100:00100000:3.0:1789120890.259650:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970596480 00000100:00100000:3.0:1789120890.259661:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970595840 00000100:00100000:3.0:1789120890.259663:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970595840 00000100:00100000:3.0:1789120890.259673:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970596352 00000100:00100000:3.0:1789120890.259676:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970596352 00000100:00100000:3.0:1789120890.259688:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789120890.259693:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf661a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970595968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259724:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf661a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970595968:12345-0@lo:400:kworker.0 Request processed in 31us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.259731:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789120890.259758:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789120890.259764:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf6612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970596480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259791:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf6612c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970596480:12345-0@lo:400:kworker.0 Request processed in 27us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.259797:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789120890.259808:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789120890.259813:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf661680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970595840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259862:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf661680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970595840:12345-0@lo:400:kworker.0 Request processed in 48us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.259869:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789120890.259880:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789120890.259886:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970596352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.259909:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970596352:12345-0@lo:400:kworker.0 Request processed in 24us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.259914:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789120890.259942:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970595328 00000100:00100000:3.0:1789120890.259945:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970595328 00000100:00100000:3.0:1789120890.259961:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970595072 00000100:00100000:3.0:1789120890.259964:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970595072 00000100:00100000:3.0:1789120890.259973:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970595584 00000100:00100000:3.0:1789120890.259975:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970595584 00000100:00100000:3.0:1789120890.259985:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970596096 00000100:00100000:3.0:1789120890.259987:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970596096 00000100:00100000:3.0:1789120890.259998:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970595712 00000100:00100000:3.0:1789120890.260001:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970595712 00000100:00100000:3.0:1789120890.260011:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970596224 00000100:00100000:3.0:1789120890.260013:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970596224 00000100:00100000:3.0:1789120890.260027:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789120890.260033:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf6603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970595328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.260062:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf6603c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970595328:12345-0@lo:400:kworker.0 Request processed in 30us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.260068:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789120890.260078:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789120890.260083:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970595072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.260114:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970595072:12345-0@lo:400:kworker.0 Request processed in 31us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.260120:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789120890.260131:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789120890.260136:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf662940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970595584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.260160:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf662940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970595584:12345-0@lo:400:kworker.0 Request processed in 24us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.260166:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789120890.260176:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789120890.260183:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970596096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.260217:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970596096:12345-0@lo:400:kworker.0 Request processed in 36us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.260223:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789120890.260233:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789120890.260238:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970595712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.260265:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970595712:12345-0@lo:400:kworker.0 Request processed in 27us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.260270:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789120890.260280:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789120890.260285:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970596224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.260310:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970596224:12345-0@lo:400:kworker.0 Request processed in 26us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.260315:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789120890.260352:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970596608 00000100:00100000:3.0:1789120890.260355:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970596608 00000100:00100000:1.0:1789120890.260439:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970595456 00000100:00100000:1.0:1789120890.260444:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970595456 00000100:00100000:1.0:1789120890.260469:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970595200 00000100:00100000:1.0:1789120890.260472:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970595200 00000100:00100000:1.0:1789120890.260484:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789120890.260489:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf661e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970595456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120890.260536:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf661e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970595456:12345-0@lo:400:kworker.0 Request processed in 47us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120890.260542:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789120890.260555:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789120890.260561:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970595200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120890.260587:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970595200:12345-0@lo:400:kworker.0 Request processed in 26us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120890.260592:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:1.0:1789120890.260607:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120890.260611:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120890.260613:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120890.260616:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120890.260966:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970595328:0@lo:400:kworker.0 00010000:00080000:2.0:1789120890.260981:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468938eb480 x1876028970595840/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120890.260990:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970595840:0@lo:400:kworker.0 00010000:00080000:2.0:1789120890.261000:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468938e9e00 x1876028970596352/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120890.261007:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970596352:0@lo:400:kworker.0 00000100:00100000:2.0:1789120890.261017:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970594944:0@lo:400:kworker.0 00000100:00100000:2.0:1789120890.261025:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970595456:0@lo:400:kworker.0 00010000:00080000:2.0:1789120890.261035:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468938ead00 x1876028970595968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120890.261053:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970595968:0@lo:400:kworker.0 00010000:00080000:2.0:1789120890.261065:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf662d00 x1876028970596480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120890.261073:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970596480:0@lo:400:kworker.0 00000100:00100000:2.0:1789120890.261105:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120890.261114:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970596864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120890.261146:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.262867:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970596864 00000100:00100000:3.0:1789120890.262879:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970596864 00000100:00100000:3.0:1789120890.262908:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789120890.262917:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970596608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120890.262948:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120890.263010:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970596608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (3700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.263017:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789120890.263034:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789120890.263039:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970596864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789120890.263049:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120890.263100:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970596864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (1953us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.263106:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789120890.263131:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970596736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120890.263163:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120890.263222:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970595200:0@lo:400:kworker.0 00010000:00080000:3.0:1789120890.263237:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467831fad00 x1876028970595712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120890.263248:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970595712:0@lo:400:kworker.0 00010000:00080000:3.0:1789120890.263260:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468938ea580 x1876028970596224/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120906 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120890.263268:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970596224:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.263281:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970595072:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.263293:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970595584:0@lo:400:kworker.0 00000100:00100000:3.0:1789120890.263305:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970596096:0@lo:400:kworker.0 00010000:00080000:3.0:1789120890.263316:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783cfbc00 x1876028970596608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120890.263330:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfbc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970596608:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120890.263432:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970596736 00000100:00100000:3.0:1789120890.263436:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970596736 00000100:00100000:3.0:1789120890.263454:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789120890.263459:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970596736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120890.263482:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120890.263517:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970596736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.263523:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:3.0:1789120890.263549:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b3bc00 x1876028970596736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120890.263561:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970596736:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789120890.264078:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b3b480 x1876028970596864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120890.264093:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970596864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120890.322190:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120890.322228:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120890.322254:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120890.322272:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120890.322293:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120890.322353:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947448832 00000100:00100000:3.0:1789120890.322363:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947448832 00000100:00100000:3.0:1789120890.322431:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947449088 00000100:00100000:3.0:1789120890.322434:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947449088 00000100:00100000:3.0:1789120890.322449:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947448960 00000100:00100000:3.0:1789120890.322450:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947448960 00000100:00100000:3.0:1789120890.322462:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947449216 00000100:00100000:3.0:1789120890.322464:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947449216 00000100:00100000:3.0:1789120890.322481:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 171 00000100:00100000:3.0:1789120890.322490:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947448832:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120890.322563:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947448832:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 73us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.322571:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 171 00000100:00100000:3.0:1789120890.322592:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 172 00000100:00100000:3.0:1789120890.322598:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947449088:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120890.322623:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947449088:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.322630:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 172 00000100:00100000:3.0:1789120890.322643:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 173 00000100:00100000:3.0:1789120890.322660:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947448960:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120890.322685:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947448960:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.322691:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 173 00000100:00100000:3.0:1789120890.322704:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 174 00000100:00100000:3.0:1789120890.322710:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947449216:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120890.322733:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947449216:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 23us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.322739:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 174 00000100:00100000:3.0:1789120890.322777:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947448704 00000100:00100000:3.0:1789120890.322781:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947448704 00000100:00100000:3.0:1789120890.322804:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 313 00000100:00100000:3.0:1789120890.322811:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2409:x1876028947448704:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120890.322863:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2409:x1876028947448704:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 52us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120890.322869:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 313 00000100:00080000:2.0:1789120890.323143:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789120890.323148:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120890.324141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120890.324221:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120890.336327:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947449344 00000100:00100000:2.0:1789120890.336342:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947449344 00000100:00100000:2.0:1789120890.336443:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947449472 00000100:00100000:2.0:1789120890.336447:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947449472 00000100:00100000:2.0:1789120890.336479:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:2.0:1789120890.336490:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2408:x1876028947449344:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:2.0:1789120890.336527:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f445 00000100:00080000:2.0:1789120890.336538:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9467830af000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789120890.336587:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00080000:0.0:1789120890.337023:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120890.337028:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120890.339275:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+2:2408:x1876028947449344:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 2776us (15128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120890.339306:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:2.0:1789120890.339342:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:2.0:1789120890.339354:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2408:x1876028947449472:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:2.0:1789120890.339383:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f44c 00000100:00080000:2.0:1789120890.339393:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9467830ae800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789120890.339441:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:2.0:1789120890.339531:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+2:2408:x1876028947449472:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 181us (15309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120890.339538:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00010000:00010000:2.0:1789120890.339573:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120890.339579:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120890.577943:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120890.774954:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120890.774978:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970596992:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789120890.775049:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120890.775166:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970596992 00000100:00100000:1.0:1789120890.775175:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970596992 00000100:00100000:1.0:1789120890.775229:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789120890.775239:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970596992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789120890.775260:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120890.775319:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970596992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 80us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120890.775326:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:2.0:1789120890.775775:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893a7c000 x1876028970596992/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120906 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120890.775797:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970596992:0@lo:13:osp-pre-1-1.0 00000020:00000004:0.0:1789120891.514876:0:12911:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789120891.515120:0:12911:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789120891.602115:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120892.626099:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120893.330379:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970597120:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120893.330462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120893.330786:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970597120 00000100:00100000:2.0:1789120893.330794:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970597120 00000100:00100000:2.0:1789120893.330874:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789120893.330884:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970597120:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789120893.330919:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120893.330971:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970597120:12345-0@lo:41:osp-pre-1-0.0 Request processed in 88us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120893.330979:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789120893.331023:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970597120:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120893.331300:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970597248:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120893.331332:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120893.331405:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970597248 00000100:00100000:2.0:1789120893.331417:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970597248 00000100:00100000:2.0:1789120893.331449:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789120893.331456:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970597248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789120893.331475:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789120893.331695:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970597248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 238us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120893.331702:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789120893.331806:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cf8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970597248:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789120893.650043:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120894.674031:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789120895.169344:0:13056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789120895.380119:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970597376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120895.380197:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120895.380279:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970597376 00000100:00100000:3.0:1789120895.380302:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970597376 00000100:00100000:3.0:1789120895.380360:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789120895.380372:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970597376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120895.380402:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120895.380447:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970597376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120895.380454:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1789120895.380476:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789120895.380508:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5da40 x1876028970597376/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120895.380528:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970597376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789120895.380778:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970597760:0@lo:400:kworker.0 00000100:00100000:1.0:1789120895.380813:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120895.380888:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970598272:0@lo:400:kworker.0 00000100:00100000:1.0:1789120895.380917:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120895.380933:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970598784:0@lo:400:kworker.0 00000100:00100000:1.0:1789120895.380957:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120895.380976:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789120895.380981:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970597632:0@lo:400:kworker.0 00000100:00100000:1.0:1789120895.381003:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120895.381016:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970598144:0@lo:400:kworker.0 00000100:00100000:1.0:1789120895.381036:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120895.381049:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970598656:0@lo:400:kworker.0 00000100:00100000:1.0:1789120895.381069:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120895.381234:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970598784 00000100:00100000:2.0:1789120895.381239:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970598784 00000100:00100000:2.0:1789120895.381299:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789120895.381308:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970598784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.381353:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970598784:12345-0@lo:400:kworker.0 Request processed in 47us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120895.381360:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:2.0:1789120895.381395:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bce580 x1876028970598784/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120895.381406:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bce580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970598784:0@lo:400:kworker.0 00000100:00080000:1.0:1789120895.382982:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120895.384571:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970597760 00000100:00100000:3.0:1789120895.384583:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970597760 00000100:00100000:3.0:1789120895.384656:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789120895.384666:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970597760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120895.384810:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970597760:12345-0@lo:400:kworker.0 Request processed in 145us (3995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120895.384817:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789120895.384958:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970598272 00000100:00100000:3.0:1789120895.384963:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970598272 00000100:00100000:3.0:1789120895.384996:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970597632 00000100:00100000:3.0:1789120895.384999:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970597632 00000100:00100000:3.0:1789120895.385010:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970598144 00000100:00100000:3.0:1789120895.385026:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970598144 00000100:00100000:3.0:1789120895.385044:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970598656 00000100:00100000:3.0:1789120895.385046:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970598656 00000100:00100000:3.0:1789120895.385061:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789120895.385067:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970598272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120895.385458:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970598272:12345-0@lo:400:kworker.0 Request processed in 388us (4538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120895.385467:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789120895.385481:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789120895.385487:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970597632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120895.385517:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970597632:12345-0@lo:400:kworker.0 Request processed in 31us (4514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120895.385522:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789120895.385533:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789120895.385539:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970598144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120895.385566:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970598144:12345-0@lo:400:kworker.0 Request processed in 27us (4529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120895.385571:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789120895.385582:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789120895.385589:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970598656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120895.385616:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970598656:12345-0@lo:400:kworker.0 Request processed in 29us (4546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120895.385621:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789120895.386457:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970599168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120895.386504:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120895.386558:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970599168 00000100:00100000:2.0:1789120895.386563:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970599168 00000100:00100000:2.0:1789120895.386601:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789120895.386609:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970599168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120895.386625:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120895.386662:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970599168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 54us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120895.386678:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:2.0:1789120895.386731:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b3bc00 x1876028970599168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120895.386748:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970599168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120895.388262:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970597504:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.388337:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120895.388388:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970598016:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.388412:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120895.388431:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970598528:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.388458:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120895.388476:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970599040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120895.388499:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120895.388521:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789120895.388527:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970597888:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.388548:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120895.388566:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970598400:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.388585:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120895.388603:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970598912:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.388619:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120895.388643:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970598016 00000100:00100000:2.0:1789120895.388649:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970598016 00000100:00100000:2.0:1789120895.388736:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789120895.388745:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970598016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.388810:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970598016:12345-0@lo:400:kworker.0 Request processed in 67us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120895.388817:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789120895.389045:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970597504 00000100:00100000:1.0:1789120895.389050:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970597504 00000100:00100000:1.0:1789120895.389098:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789120895.389105:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970597504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120895.389138:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970597504:12345-0@lo:400:kworker.0 Request processed in 35us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120895.389144:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:1.0:1789120895.389172:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970598400 00000100:00100000:1.0:1789120895.389175:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970598400 00000100:00100000:1.0:1789120895.389199:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970598912 00000100:00100000:1.0:1789120895.389202:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970598912 00000100:00100000:1.0:1789120895.389225:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789120895.389231:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970598400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120895.389261:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ea580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970598400:12345-0@lo:400:kworker.0 Request processed in 31us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120895.389274:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789120895.389302:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789120895.389309:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970598912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120895.389340:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970598912:12345-0@lo:400:kworker.0 Request processed in 33us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120895.389346:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789120895.390061:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970598528 00000100:00100000:3.0:1789120895.390068:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970598528 00000100:00100000:3.0:1789120895.390101:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970597888 00000100:00100000:3.0:1789120895.390105:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970597888 00000100:00100000:3.0:1789120895.390134:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789120895.390141:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf662d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970598528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120895.390187:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf662d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970598528:12345-0@lo:400:kworker.0 Request processed in 47us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120895.390192:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789120895.390207:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789120895.390213:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970597888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120895.390242:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970597888:12345-0@lo:400:kworker.0 Request processed in 29us (1692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120895.390248:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00080000:2.0:1789120895.391437:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120895.391446:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120895.391449:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120895.391453:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789120895.391510:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970597632:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.391527:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970598144:0@lo:400:kworker.0 00010000:00080000:2.0:1789120895.391542:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf70da40 x1876028970598656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120895.391552:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970598656:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.391566:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970597760:0@lo:400:kworker.0 00010000:00080000:2.0:1789120895.391576:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893a7f0c0 x1876028970598272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120895.391583:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970598272:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.391636:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970597888:0@lo:400:kworker.0 00010000:00080000:2.0:1789120895.391648:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893a7c000 x1876028970598400/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120895.391656:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970598400:0@lo:400:kworker.0 00010000:00080000:2.0:1789120895.391666:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bcda40 x1876028970598912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120911 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120895.391674:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970598912:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.391714:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970597504:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.391725:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970598016:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.391736:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970598528:0@lo:400:kworker.0 00000100:00100000:2.0:1789120895.391769:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970599040 00000100:00100000:2.0:1789120895.391774:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970599040 00000100:00100000:2.0:1789120895.391814:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789120895.391837:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970599040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120895.395194:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120895.396333:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970599040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4504us (7825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120895.396345:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1789120895.411522:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b3a940 x1876028970599040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120895.411554:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b3a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970599040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120895.443979:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120895.444014:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120895.444035:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120895.444954:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947449856 00000100:00100000:1.0:1789120895.444967:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947449856 00000100:00100000:1.0:1789120895.445036:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947450112 00000100:00100000:1.0:1789120895.445040:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947450112 00000100:00100000:1.0:1789120895.445079:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 181 00000100:00100000:1.0:1789120895.445089:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947449856:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120895.445165:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947449856:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 77us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120895.445173:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 181 00000100:00100000:1.0:1789120895.445190:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 182 00000100:00100000:1.0:1789120895.445197:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947450112:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120895.445221:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eada40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947450112:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120895.445227:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 182 00000100:00100000:1.0:1789120895.445247:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947449600 00000100:00100000:1.0:1789120895.445263:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947449600 00000100:00100000:1.0:1789120895.445426:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 315 00000100:00100000:1.0:1789120895.445434:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947449600:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120895.445460:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947449600:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120895.445465:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 315 00000100:00100000:0.0:1789120895.446152:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120895.446262:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00080000:2.0:1789120895.446406:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789120895.447187:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947449728 00000100:00100000:3.0:1789120895.447195:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947449728 00000100:00100000:3.0:1789120895.447246:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947449984 00000100:00100000:3.0:1789120895.447250:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947449984 00000100:00100000:3.0:1789120895.447269:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 183 00000100:00100000:3.0:1789120895.447277:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947449728:12345-192.168.202.32@tcp:400:kworker.0 00000100:00080000:2.0:1789120895.447605:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120895.448625:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947449728:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 1340us (4566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120895.448637:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 183 00000100:00100000:3.0:1789120895.448667:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 184 00000100:00100000:3.0:1789120895.448679:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947449984:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120895.448729:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947449984:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 54us (2467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120895.448736:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 184 00010000:00010000:3.0:1789120895.700101:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120895.890316:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120895.890340:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970599296:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789120895.890415:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120895.890549:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970599296 00000100:00100000:1.0:1789120895.890558:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970599296 00000100:00100000:1.0:1789120895.890611:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789120895.890620:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970599296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789120895.890642:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120895.890708:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970599296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120895.890716:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:3.0:1789120895.890794:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783bce1c0 x1876028970599296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120911 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120895.890853:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bce1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970599296:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1789120895.899545:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 33ce8665-4f0b-4ca8-add3-a8f074595c87 00000020:00000080:3.0:1789120895.899554:0:9516:0:(genops.c:885:class_export_put()) final put ffff9467830ab000/33ce8665-4f0b-4ca8-add3-a8f074595c87 00000001:00100000:0.0:1789120895.899703:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 33ce8665-4f0b-4ca8-add3-a8f074595c87 00000020:00000080:0.0:1789120895.899708:0:8428:0:(genops.c:885:class_export_put()) final put ffff9467830a8800/33ce8665-4f0b-4ca8-add3-a8f074595c87 00000020:00000080:1.0:1789120895.901018:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9467830ab000/33ce8665-4f0b-4ca8-add3-a8f074595c87 for lustre-OST0001 00000020:00000080:1.0:1789120895.901083:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9467830ae800 for lustre-OST0001 00000020:00000080:3.0:1789120895.901414:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9467830a8800/33ce8665-4f0b-4ca8-add3-a8f074595c87 for lustre-OST0000 00000020:00000080:3.0:1789120895.901521:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9467830af000 for lustre-OST0000 00010000:00010000:2.0:1789120896.727010:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120897.747440:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120898.450813:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120898.450863:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970599424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120898.450962:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120898.453095:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970599424 00000100:00100000:2.0:1789120898.453114:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970599424 00000100:00100000:2.0:1789120898.453229:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1789120898.453243:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970599424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789120898.453294:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789120898.453412:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970599424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 172us (2451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120898.453421:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789120898.453546:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783bcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970599552:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120898.453609:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120898.461721:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970599424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789120898.462124:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970599552 00000100:00100000:3.0:1789120898.462135:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970599552 00000100:00100000:3.0:1789120898.462197:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789120898.462209:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970599552:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789120898.462254:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789120898.462347:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970599552:12345-0@lo:41:osp-pre-1-0.0 Request processed in 140us (8737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120898.462356:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789120898.463284:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783bcda40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970599552:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789120898.772099:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789120899.298177:0:13205:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd111d870 20000000:00000080:3.0:1789120899.298204:0:13205:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9467821d3800 uarg=0000000000000000 20000000:01000000:3.0:1789120899.298268:0:13205:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789120899.298275:0:13205:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789120899.298282:0:13205:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1789120899.300538:0:13206:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789120899.300747:0:13205:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789120899.317562:0:13205:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789120899.317683:0:13205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.317718:0:13205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f3e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f8 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.317728:0:13205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f3f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f3ea expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.317759:0:13205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946887082800/0xb74d2367a830f3ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f3f8 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.317767:0:13205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468c217c000/0xb74d2367a830f40d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f406 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.317775:0:13205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468c217d200/0xb74d2367a830f41b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f414 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.317783:0:13205:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946887083800/0xb74d2367a830f430 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e937 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.317791:0:13205:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.318251:0:13205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946887083800/0xb74d2367a830f430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e937 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.318271:0:13205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946887083800/0xb74d2367a830f430 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e937 expref: 12 pid: 6513 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120899.318290:0:13205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970599680:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120899.318516:0:13205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468c217d200/0xb74d2367a830f41b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f414 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.318527:0:13205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468c217d200/0xb74d2367a830f41b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f414 expref: 23 pid: 6510 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120899.318536:0:13205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970599808:0@lo:104: 00000100:00100000:3.0:1789120899.318596:0:13205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120899.318652:0:13205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468c217c000/0xb74d2367a830f40d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f406 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.318670:0:13205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468c217c000/0xb74d2367a830f40d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f406 expref: 23 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120899.318678:0:13205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970599936:0@lo:104: 00000100:00100000:3.0:1789120899.318707:0:13205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120899.318731:0:13205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946887082800/0xb74d2367a830f3ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f3f8 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.318739:0:13205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946887082800/0xb74d2367a830f3ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f3f8 expref: 23 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120899.318748:0:13205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970600064:0@lo:104: 00000100:00100000:3.0:1789120899.318771:0:13205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120899.318807:0:13205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f3f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f3ea expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.318815:0:13205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f3f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f3ea expref: 23 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120899.318855:0:13205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970600192:0@lo:104: 00000100:00100000:3.0:1789120899.318879:0:13205:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120899.318906:0:13205:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f3e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f8 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.318915:0:13205:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f3e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f8 expref: 12 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120899.318936:0:13205:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970600320:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120899.318975:0:13205:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b299c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120899.319505:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970599808 00000100:00100000:2.0:1789120899.319514:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970599808 00000100:00100000:2.0:1789120899.319567:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970599936 00000100:00100000:2.0:1789120899.319570:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970599936 00000100:00100000:2.0:1789120899.319581:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970600064 00000100:00100000:2.0:1789120899.319583:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970600064 00000100:00100000:2.0:1789120899.319592:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970600192 00000100:00100000:2.0:1789120899.319595:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970600192 00000100:00100000:2.0:1789120899.319608:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789120899.319618:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+6:13205:x1876028970599808:12345-0@lo:104: 00010000:00010000:2.0:1789120899.319635:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.319741:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120899.319747:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+6:13205:x1876028970599808:12345-0@lo:104: Request processed in 130us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120899.319755:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789120899.319775:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789120899.319780:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+5:13205:x1876028970599936:12345-0@lo:104: 00010000:00010000:2.0:1789120899.319785:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.319813:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789120899.319816:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+5:13205:x1876028970599936:12345-0@lo:104: Request processed in 37us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120899.319845:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789120899.319852:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789120899.319856:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:13205:x1876028970600064:12345-0@lo:104: 00010000:00010000:2.0:1789120899.319869:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.319894:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789120899.319897:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:13205:x1876028970600064:12345-0@lo:104: Request processed in 41us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120899.319902:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789120899.319910:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789120899.319913:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:13205:x1876028970600192:12345-0@lo:104: 00010000:00010000:2.0:1789120899.319918:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.319940:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789120899.319943:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:13205:x1876028970600192:12345-0@lo:104: Request processed in 30us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120899.319946:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1789120899.319973:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789120899.319981:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.319988:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217de00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120899.319993:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320002:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120899.320010:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120899.320023:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120899.320059:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320064:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120899.320081:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320087:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c217de00/0xb74d2367a830f414 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f41b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320100:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789120899.320102:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320105:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120899.320107:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320112:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120899.320116:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120899.320119:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120899.320127:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320130:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120899.320138:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320143:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f406 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f40d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320148:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789120899.320150:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320154:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887082c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120899.320156:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320160:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120899.320163:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120899.320166:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120899.320173:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320176:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120899.320186:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320189:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887082c00/0xb74d2367a830f3f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f3ff expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320194:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120899.320199:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320203:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120899.320205:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320209:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120899.320212:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120899.320215:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120899.320223:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320228:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120899.320233:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320240:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a830f3ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f3f1 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320254:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120899.320255:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120899.320257:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120899.320265:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120899.320272:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120899.320286:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970600448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120899.320315:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120899.320342:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120899.320345:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970600576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120899.320358:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120899.320382:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970600448 00000100:00100000:2.0:1789120899.320384:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970600448 00010000:00010000:2.0:1789120899.320401:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468c217d200/0xb74d2367a830f41b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f414 expref: 24 pid: 6510 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120899.320415:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970600576 00000100:00100000:2.0:1789120899.320417:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970600576 00010000:00010000:2.0:1789120899.320423:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468c217c000/0xb74d2367a830f40d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f406 expref: 25 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120899.320433:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789120899.320437:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+25:3646:x1876028970600448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120899.320446:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120899.320449:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468c217d200/0xb74d2367a830f41b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f414 expref: 25 pid: 6510 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320457:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468c217d200/0xb74d2367a830f41b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f414 expref: 25 pid: 6510 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320473:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120899.320490:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+25:3646:x1876028970600448:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120899.320494:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789120899.320502:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789120899.320505:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970600576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120899.320511:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120899.320518:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468c217c000/0xb74d2367a830f40d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f406 expref: 24 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320524:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468c217c000/0xb74d2367a830f40d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f406 expref: 24 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.320530:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120899.320544:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970600576:12345-0@lo:103:ldlm_bl.0 Request processed in 38us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120899.320548:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789120899.320577:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970600576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120899.320582:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970600448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120899.321206:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120899.321225:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970600832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120899.321278:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120899.321321:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120899.321327:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970600704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120899.321349:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120899.321377:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970600832 00000100:00100000:1.0:1789120899.321382:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970600832 00010000:00010000:1.0:1789120899.321408:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f3f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f3ea expref: 24 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120899.321431:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970600704 00000100:00100000:1.0:1789120899.321433:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970600704 00010000:00010000:1.0:1789120899.321445:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946887082800/0xb74d2367a830f3ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f3f8 expref: 25 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120899.321458:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789120899.321464:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+25:3645:x1876028970600832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120899.321474:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120899.321478:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f3f1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f3ea expref: 25 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120899.321488:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f3f1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f3ea expref: 25 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120899.321505:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120899.321534:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+25:3645:x1876028970600832:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120899.321540:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789120899.321555:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789120899.321561:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970600704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120899.321576:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120899.321580:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946887082800/0xb74d2367a830f3ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f3f8 expref: 24 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120899.321587:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946887082800/0xb74d2367a830f3ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f3f8 expref: 24 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120899.321596:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120899.321616:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970600704:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120899.321622:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789120899.321676:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970600704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120899.321686:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970600832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120899.324592:0:13205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217d200/0xb74d2367a830f41b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f414 expref: 23 pid: 6510 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120899.324625:0:13205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970599808:0@lo:104: 00010000:00010000:3.0:1789120899.324640:0:13205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217c000/0xb74d2367a830f40d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f406 expref: 22 pid: 6513 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120899.324651:0:13205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970599936:0@lo:104: 00010000:00010000:3.0:1789120899.324676:0:13205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887082800/0xb74d2367a830f3ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f3f8 expref: 21 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120899.324686:0:13205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5cb40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970600064:0@lo:104: 00010000:00010000:3.0:1789120899.324697:0:13205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f3f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f3ea expref: 20 pid: 6512 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120899.324706:0:13205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970600192:0@lo:104: 00000100:00100000:0.0:1789120899.330206:0:13205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5d680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970599680:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120899.330244:0:13205:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13205:1876028970600320:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120899.330290:0:13205:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120899.331376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120899.331486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120899.331568:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947450240 00000100:00100000:2.0:1789120899.331577:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947450240 00010000:00010000:2.0:1789120899.331635:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946887083800/0xb74d2367a830f430 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e937 expref: 13 pid: 6513 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120899.331687:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947450368 00000100:00100000:2.0:1789120899.331691:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947450368 00010000:00010000:2.0:1789120899.331705:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f3e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f8 expref: 14 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120899.331735:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:2.0:1789120899.331746:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+14:2412:x1876028947450240:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120899.331772:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120899.331778:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946887083800/0xb74d2367a830f430 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e937 expref: 14 pid: 6513 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.331791:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946887083800/0xb74d2367a830f430 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e937 expref: 14 pid: 6513 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.331853:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887083800/0xb74d2367a830f430 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e937 expref: 14 pid: 6513 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.331874:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120899.331945:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947450240:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 200us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120899.331955:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:2.0:1789120899.331977:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:2.0:1789120899.331986:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:2412:x1876028947450368:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120899.331994:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120899.331999:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f3e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f8 expref: 12 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332008:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f3e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f8 expref: 12 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332018:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f3e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f8 expref: 12 pid: 6512 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332029:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332039:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332057:0:6505:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332073:0:6505:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332080:0:6505:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332087:0:6505:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332095:0:6505:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789120899.332100:0:6505:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332109:0:6505:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332133:0:6505:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.332145:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120899.332165:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835ef050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+11:2412:x1876028947450368:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 180us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120899.332171:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 45 00010000:00010000:3.0:1789120899.332310:0:13205:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.332321:0:13205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120899.332328:0:13205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217d600/0xb74d2367a830f453 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120899.794153:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120900.498619:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120900.498667:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970600960:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120900.498770:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120900.498879:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970600960 00000100:00100000:3.0:1789120900.498887:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970600960 00000100:00100000:3.0:1789120900.498944:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789120900.498952:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970600960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120900.498986:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120900.499026:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970600960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120900.499032:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789120900.499060:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789120900.499097:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9e940 x1876028970600960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120900.499118:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970600960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120900.500950:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120900.500980:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970601088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120900.501195:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120900.502487:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970601088 00000100:00100000:2.0:1789120900.502510:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970601088 00000100:00080000:0.0:1789120900.502575:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120900.502592:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789120900.502603:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970601088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120900.502635:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120900.502733:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b93840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970601088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120900.502742:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1789120900.502776:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9e940 x1876028970601088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120900.502804:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970601088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120900.503282:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970601600:0@lo:400:kworker.0 00000100:00100000:0.0:1789120900.503334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120900.503372:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970602112:0@lo:400:kworker.0 00000100:00100000:0.0:1789120900.503407:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120900.503439:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789120900.503445:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970601472:0@lo:400:kworker.0 00000100:00100000:0.0:1789120900.503473:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120900.503493:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970601984:0@lo:400:kworker.0 00000100:00100000:0.0:1789120900.503514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120900.503531:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970602496:0@lo:400:kworker.0 00000100:00100000:0.0:1789120900.503558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120900.504887:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970601216:0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.504959:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120900.505022:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970601728:0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.505053:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120900.505075:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970602240:0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.505099:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120900.505128:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789120900.505136:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970601344:0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.505159:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120900.505177:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970601856:0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.505201:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120900.505213:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970602368:0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.505276:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120900.505330:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970602496 00000100:00100000:1.0:1789120900.505339:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970602496 00000100:00100000:1.0:1789120900.505440:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970602368 00000100:00100000:1.0:1789120900.505444:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970602368 00000100:00100000:1.0:1789120900.505471:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789120900.505481:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf703c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970602496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.505631:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf703c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970602496:12345-0@lo:400:kworker.0 Request processed in 149us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120900.505639:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789120900.505669:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789120900.505676:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970602368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.505709:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970602368:12345-0@lo:400:kworker.0 Request processed in 33us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120900.505715:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789120900.505740:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970601472 00000100:00100000:1.0:1789120900.505744:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970601472 00000100:00100000:1.0:1789120900.505766:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970601728 00000100:00100000:1.0:1789120900.505768:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970601728 00000100:00100000:1.0:1789120900.505781:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789120900.505787:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf701680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970601472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.505850:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf701680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970601472:12345-0@lo:400:kworker.0 Request processed in 34us (2347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120900.505857:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1789120900.505867:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789120900.505873:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970601728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.505901:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970601728:12345-0@lo:400:kworker.0 Request processed in 28us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120900.505917:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789120900.505939:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970601600 00000100:00100000:1.0:1789120900.505948:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970601600 00000100:00100000:1.0:1789120900.505970:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970602112 00000100:00100000:1.0:1789120900.505973:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970602112 00000100:00100000:1.0:1789120900.505987:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970601984 00000100:00100000:1.0:1789120900.505990:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970601984 00000100:00100000:1.0:1789120900.506004:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970602240 00000100:00100000:1.0:1789120900.506007:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970602240 00000100:00100000:1.0:1789120900.506019:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970601344 00000100:00100000:1.0:1789120900.506022:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970601344 00000100:00100000:1.0:1789120900.506035:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970601856 00000100:00100000:1.0:1789120900.506038:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970601856 00000100:00100000:1.0:1789120900.506051:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789120900.506058:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf702d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970601600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.506094:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf702d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970601600:12345-0@lo:400:kworker.0 Request processed in 36us (2759us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120900.506100:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1789120900.506111:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789120900.506117:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf702580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970602112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.506148:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf702580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970602112:12345-0@lo:400:kworker.0 Request processed in 31us (2752us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120900.506154:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789120900.506163:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789120900.506168:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf701e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970601984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.506193:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf701e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970601984:12345-0@lo:400:kworker.0 Request processed in 25us (2678us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120900.506198:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1789120900.506217:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789120900.506223:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970602240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.506251:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970602240:12345-0@lo:400:kworker.0 Request processed in 29us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120900.506256:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789120900.506265:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789120900.506271:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970601344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.506298:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970601344:12345-0@lo:400:kworker.0 Request processed in 26us (1137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120900.506304:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789120900.506314:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789120900.506320:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970601856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.506345:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970601856:12345-0@lo:400:kworker.0 Request processed in 25us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120900.506351:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789120900.506409:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970601344:0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.506421:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970601856:0@lo:400:kworker.0 00010000:00080000:1.0:1789120900.506434:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d1e00 x1876028970602368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120900.506445:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970602368:0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.506455:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970601728:0@lo:400:kworker.0 00010000:00080000:1.0:1789120900.506466:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d1a40 x1876028970602240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120900.506485:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970602240:0@lo:400:kworker.0 00000100:00100000:0.0:1789120900.506699:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970601216 00000100:00100000:0.0:1789120900.506705:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970601216 00000100:00100000:0.0:1789120900.506745:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1789120900.506752:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:3644:x1876028970601216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120900.506790:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+20:3644:x1876028970601216:12345-0@lo:400:kworker.0 Request processed in 39us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120900.506797:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1789120900.509957:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970601216:0@lo:400:kworker.0 00000100:00080000:1.0:1789120900.510017:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120900.510025:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120900.510030:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120900.510064:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970601472:0@lo:400:kworker.0 00010000:00080000:1.0:1789120900.510086:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d3c00 x1876028970601984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120900.510099:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970601984:0@lo:400:kworker.0 00010000:00080000:1.0:1789120900.510114:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf7012c0 x1876028970602496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120916 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120900.510122:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7012c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970602496:0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.510140:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970601600:0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.510154:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970602112:0@lo:400:kworker.0 00000100:00100000:1.0:1789120900.512975:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970602624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120900.513083:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120900.513198:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970602624 00000100:00100000:2.0:1789120900.513208:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970602624 00000100:00100000:2.0:1789120900.513281:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789120900.513292:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970602624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120900.513332:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120900.513391:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970602624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120900.513400:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00010000:00080000:1.0:1789120900.513750:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893a7fc00 x1876028970602624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120916 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120900.513773:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970602624:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120900.560141:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120900.560185:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120900.560214:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120900.560232:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120900.560309:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120900.560619:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947450624 00000100:00100000:0.0:1789120900.560630:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947450624 00000100:00100000:0.0:1789120900.560725:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947450880 00000100:00100000:0.0:1789120900.560728:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947450880 00000100:00100000:0.0:1789120900.560740:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947450752 00000100:00100000:0.0:1789120900.560742:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947450752 00000100:00100000:0.0:1789120900.560754:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947451008 00000100:00100000:0.0:1789120900.560756:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947451008 00000100:00100000:0.0:1789120900.560774:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 191 00000100:00100000:0.0:1789120900.560784:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947450624:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120900.560906:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947450624:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 123us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120900.560914:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 191 00000100:00100000:0.0:1789120900.560932:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 192 00000100:00100000:0.0:1789120900.560937:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947450880:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120900.560956:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947450880:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 19us (771us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120900.560962:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 192 00000100:00100000:0.0:1789120900.560970:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 193 00000100:00100000:0.0:1789120900.560975:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947450752:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120900.560993:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947450752:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 18us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120900.560999:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 193 00000100:00100000:0.0:1789120900.561008:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 194 00000100:00100000:0.0:1789120900.561013:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947451008:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120900.561030:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947451008:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 18us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120900.561045:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 194 00000100:00080000:3.0:1789120900.561261:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120900.561267:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120900.561813:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947450496 00000100:00100000:1.0:1789120900.561855:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947450496 00000100:00100000:1.0:1789120900.561913:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 317 00000100:00100000:1.0:1789120900.561921:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+11:2411:x1876028947450496:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120900.561991:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+11:2411:x1876028947450496:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 71us (1775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120900.561997:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 317 00010000:00010000:1.0:1789120900.820134:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120901.011228:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970602752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789120901.011337:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120901.011786:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970602752 00000100:00100000:3.0:1789120901.011805:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970602752 00000100:00100000:3.0:1789120901.011906:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789120901.011918:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970602752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789120901.011952:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120901.012039:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970602752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 113us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120901.012059:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00010000:00080000:3.0:1789120901.012115:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9de00 x1876028970602752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120917 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120901.012139:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970602752:0@lo:13:osp-pre-1-1.0 10000000:01000000:0.0:1789120901.076213:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789120901.076224:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946782aee800 from 7 10000000:01000000:0.0:1789120901.076231:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120901.076302:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120901.076317:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120901.076333:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120901.076372:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970602880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120901.076470:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120901.076559:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946781089240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120901.077543:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970602880 00000100:00100000:3.0:1789120901.077555:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970602880 00000100:00100000:3.0:1789120901.077613:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:3.0:1789120901.077623:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970602880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120901.077656:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120901.077688:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c217d600/0xb74d2367a830f461 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f45a expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120901.077727:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217d600/0xb74d2367a830f461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f45a expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120901.077753:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c217d600/0xb74d2367a830f461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f45a expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120901.077766:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d600, rc 0) 00000100:00100000:3.0:1789120901.077904:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970602880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 281us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120901.077913:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1789120901.079405:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970602880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120901.079432:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.079444:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120901.079525:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.079576:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120901.080073:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120901.080114:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970603008 00000100:00100000:3.0:1789120901.080121:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970603008 00000100:00100000:3.0:1789120901.080170:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789120901.080181:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970603008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120901.080355:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970603008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120901.080375:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:2.0:1789120901.080443:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.080481:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.080521:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120901.080574:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120901.080707:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970603136 00000100:00100000:3.0:1789120901.080713:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970603136 00000100:00100000:2.0:1789120901.081047:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1789120901.081065:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970603136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.081162:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970603136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120901.081168:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1789120901.081310:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789120901.086110:0:13261:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789120901.086253:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789120901.086278:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789120901.086289:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120901.086301:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120901.086312:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789120901.086314:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468b9991000 from 7 10000000:01000000:1.0:1789120901.086317:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789120901.086356:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120901.086364:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120901.086376:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120901.086402:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120901.086470:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120901.086513:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789120901.086815:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970603264 00000100:00100000:3.0:1789120901.086845:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970603264 00000100:00100000:3.0:1789120901.086897:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789120901.086919:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970603264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120901.086932:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120901.086947:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f46f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f468 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120901.086972:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f46f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f468 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120901.086982:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f46f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f468 expref: 22 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120901.086991:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217cc00, rc 0) 00000100:00100000:3.0:1789120901.087035:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970603264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120901.087042:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789120901.087415:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120901.087433:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120901.087442:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120901.087511:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120901.087539:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120901.087574:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3a540 going to sleep for 11 seconds 00000100:00100000:3.0:1789120901.087619:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970603392 00000100:00100000:3.0:1789120901.087624:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970603392 00000100:00100000:3.0:1789120901.088599:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1789120901.088609:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970603392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120901.088762:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970603392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120901.088770:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789120901.088872:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.088917:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.088963:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120901.095086:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120901.097812:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970603520 00000100:00100000:1.0:1789120901.097846:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970603520 00000100:00100000:2.0:1789120901.098078:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789120901.098092:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970603520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.098272:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970603520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (9308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120901.098280:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789120901.098349:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789120901.099212:0:13262:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789120901.099276:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789120901.099297:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120901.099309:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.099321:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120901.099333:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120901.099336:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946883582800 from 7 10000000:01000000:2.0:1789120901.099339:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120901.099380:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.099389:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.099400:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120901.099423:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.099479:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120901.099516:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801900 going to sleep for 11 seconds 00000100:00100000:2.0:1789120901.099534:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970603648 00000100:00100000:2.0:1789120901.099538:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970603648 00000100:00100000:2.0:1789120901.099567:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789120901.099574:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970603648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120901.099585:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120901.099604:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1e00/0xb74d2367a830f47d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f476 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.099629:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1e00/0xb74d2367a830f47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f476 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.099654:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1e00/0xb74d2367a830f47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f476 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.099662:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1e00, rc 0) 00000100:00100000:2.0:1789120901.099698:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970603648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120901.099705:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789120901.099748:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120901.099762:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.099771:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120901.100117:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.100146:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120901.100167:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801900 going to sleep for 11 seconds 00000100:00100000:2.0:1789120901.100180:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970603776 00000100:00100000:2.0:1789120901.100183:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970603776 00000100:00100000:2.0:1789120901.100219:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789120901.100226:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970603776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.100336:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970603776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120901.100343:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1789120901.100373:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.100410:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.100747:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120901.100769:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801900 going to sleep for 11 seconds 00000100:00100000:2.0:1789120901.100783:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970603904 00000100:00100000:2.0:1789120901.100787:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970603904 00000100:00100000:2.0:1789120901.100806:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789120901.100811:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970603904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.101056:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970603904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 243us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120901.101069:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1789120901.101110:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970603904:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789120901.103318:0:13263:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789120901.103470:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789120901.103490:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120901.103501:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.103513:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120901.103524:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120901.103527:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946886899000 from 7 10000000:01000000:2.0:1789120901.103529:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120901.103562:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.103571:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.103581:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120901.103603:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970604032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.103674:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120901.103743:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860d7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789120901.103779:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970604032 00000100:00100000:1.0:1789120901.103785:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970604032 00000100:00100000:1.0:1789120901.104371:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1789120901.104382:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970604032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120901.104394:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120901.104407:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a2a00/0xb74d2367a830f48b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f484 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120901.104430:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a2a00/0xb74d2367a830f48b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f484 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120901.104441:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a2a00/0xb74d2367a830f48b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f484 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120901.104451:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2a00, rc 0) 00000100:00100000:1.0:1789120901.104503:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970604032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120901.104517:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:3.0:1789120901.104586:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970604032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120901.104600:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120901.104610:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120901.104684:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970604160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120901.104713:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120901.104816:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120901.104976:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970604160 00000100:00100000:2.0:1789120901.104981:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970604160 00000100:00100000:2.0:1789120901.105006:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1789120901.105012:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970604160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.105122:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970604160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120901.105130:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789120901.105293:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970604160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120901.105323:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970604288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120901.105360:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120901.105416:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120901.105445:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970604288 00000100:00100000:2.0:1789120901.105449:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970604288 00000100:00100000:2.0:1789120901.105510:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1789120901.105518:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970604288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120901.105595:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970604288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120901.105603:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789120901.105669:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970604288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789120901.107279:0:13264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789120901.107510:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789120901.107546:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789120901.107557:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120901.107569:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120901.201051:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120901.207387:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947451136 00000100:00100000:2.0:1789120901.207401:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947451136 00000100:00100000:2.0:1789120901.207471:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 330 00000100:00100000:2.0:1789120901.207482:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+11:6186:x1876028947451136:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120901.207501:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120901.207524:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1600/0xb74d2367a830f492 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e968 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.207561:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1600/0xb74d2367a830f492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e968 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.207574:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1600/0xb74d2367a830f492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e968 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120901.207585:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1600, rc 0) 00000100:00100000:2.0:1789120901.207665:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947451136:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 184us (6626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120901.207686:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 330 00000100:00100000:2.0:1789120901.215045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120901.218896:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947451264 00000100:00100000:0.0:1789120901.219076:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947451264 00000100:00100000:0.0:1789120901.221046:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 331 00000100:00100000:0.0:1789120901.221073:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947451264:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120901.221260:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947451264:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 200us (6225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120901.221282:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 331 00000100:00100000:1.0:1789120901.229513:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120901.229605:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947451392 00000100:00100000:0.0:1789120901.229617:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947451392 00000100:00100000:0.0:1789120901.229690:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 332 00000100:00100000:0.0:1789120901.229702:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947451392:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120901.230993:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947451392:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 1285us (1483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120901.231006:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 332 00000100:00100000:1.0:1789120901.252225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120901.257667:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947451520 00000100:00100000:0.0:1789120901.257682:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947451520 00000100:00100000:1.0:1789120901.258091:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 333 00000100:00100000:1.0:1789120901.258102:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947451520:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120901.258118:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120901.258137:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a3400/0xb74d2367a830f499 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e96f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120901.258165:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3400/0xb74d2367a830f499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e96f expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120901.258176:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a3400/0xb74d2367a830f499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e96f expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120901.258186:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3400, rc 0) 00000100:00100000:1.0:1789120901.258254:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947451520:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 154us (6039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120901.258261:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 333 00000100:00100000:0.0:1789120901.261273:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120901.261374:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947451648 00000100:00100000:1.0:1789120901.261383:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947451648 00000100:00100000:1.0:1789120901.261442:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 334 00000100:00100000:1.0:1789120901.261452:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947451648:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120901.261625:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947451648:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 173us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120901.261633:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 334 00000100:00100000:0.0:1789120901.270960:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120901.272612:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947451776 00000100:00100000:1.0:1789120901.272628:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947451776 00000100:00100000:1.0:1789120901.272718:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 335 00000100:00100000:1.0:1789120901.272728:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947451776:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120901.273270:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947451776:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 540us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120901.273279:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 335 00010000:00010000:0.0:1789120901.842086:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120902.869557:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789120903.332377:0:13403:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789120903.571032:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120903.571053:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970604416:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789120903.571125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120903.571190:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970604416 00000100:00100000:3.0:1789120903.571197:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970604416 00000100:00100000:3.0:1789120903.571238:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789120903.571246:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970604416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120903.571277:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789120903.571323:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970604416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120903.571340:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1789120903.571385:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970604416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789120903.571959:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789120903.571971:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970604544:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120903.572008:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120903.572038:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970604544 00000100:00100000:2.0:1789120903.572042:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970604544 00000100:00100000:2.0:1789120903.572068:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789120903.572074:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970604544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789120903.572095:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120903.572129:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970604544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120903.572135:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1789120903.572162:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970604544:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789120903.890068:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120904.917177:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120905.619126:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120905.619157:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970604672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120905.620099:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120905.622035:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970604672 00000100:00100000:1.0:1789120905.622056:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970604672 00000100:00100000:1.0:1789120905.622171:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789120905.623429:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970604672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120905.623495:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120905.624191:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970604928:0@lo:400:kworker.0 00000100:00100000:0.0:1789120905.624289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120905.624348:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120905.624356:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970604800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120905.624387:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120905.624420:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970604928 00000100:00100000:0.0:1789120905.624428:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970604928 00000100:00100000:0.0:1789120905.624480:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789120905.624488:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970604928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120905.624539:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970604928:12345-0@lo:400:kworker.0 Request processed in 50us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120905.624566:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1789120905.624614:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120905.624625:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970605056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120905.624654:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120905.624706:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970604928:0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.625682:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970604672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2274us (5583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.625694:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789120905.625720:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970604800 00000100:00100000:1.0:1789120905.625732:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970604800 00000100:00100000:1.0:1789120905.625762:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970605056 00000100:00100000:1.0:1789120905.625765:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970605056 00000100:00100000:1.0:1789120905.625785:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789120905.625792:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970604800:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789120905.625838:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120905.625885:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7012c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970604800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.625892:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789120905.625904:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789120905.625910:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970605056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120905.625920:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120905.625949:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970605056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.625955:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1789120905.625977:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120905.625983:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789120905.626024:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf703480 x1876028970605056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120905.626046:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970605056:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1789120905.626087:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf700000 x1876028970604800/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120905.626102:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970604800:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789120905.626138:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783e5a1c0 x1876028970604672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120921 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120905.626153:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e5a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970604672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120905.635123:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970605184:0@lo:400:kworker.0 00000100:00100000:0.0:1789120905.635181:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970605312:0@lo:400:kworker.0 00000100:00100000:0.0:1789120905.635239:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120905.635240:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120905.642108:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970605696:0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.645450:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120905.645539:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970606208:0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.645612:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120905.645653:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789120905.645662:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970605568:0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.645695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120905.645724:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970606080:0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.645754:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120905.645805:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970605184 00000100:00100000:1.0:1789120905.645817:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970605184 00000100:00100000:1.0:1789120905.645906:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970605696 00000100:00100000:1.0:1789120905.645909:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970605696 00000100:00100000:1.0:1789120905.645934:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970606080 00000100:00100000:1.0:1789120905.645936:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970606080 00000100:00100000:1.0:1789120905.645953:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789120905.645962:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970605184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646040:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970605184:12345-0@lo:400:kworker.0 Request processed in 79us (10808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.646049:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789120905.646070:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789120905.646076:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970605696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646105:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e59e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970605696:12345-0@lo:400:kworker.0 Request processed in 30us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.646125:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789120905.646136:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789120905.646142:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970606080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646170:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970606080:12345-0@lo:400:kworker.0 Request processed in 28us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.646176:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1789120905.646202:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970606208 00000100:00100000:1.0:1789120905.646206:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970606208 00000100:00100000:1.0:1789120905.646238:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789120905.646245:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970606208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646278:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970606208:12345-0@lo:400:kworker.0 Request processed in 33us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.646284:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789120905.646310:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120905.646316:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120905.646318:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120905.646340:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970605440:0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646370:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120905.646390:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970605952:0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646413:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120905.646442:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970605440 00000100:00100000:1.0:1789120905.646446:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970605440 00000100:00100000:1.0:1789120905.646466:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970605952 00000100:00100000:1.0:1789120905.646469:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970605952 00000100:00100000:1.0:1789120905.646490:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789120905.646496:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970605440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646541:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e59a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970605440:12345-0@lo:400:kworker.0 Request processed in 44us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.646548:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789120905.646560:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789120905.646566:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970605952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646592:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e583c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970605952:12345-0@lo:400:kworker.0 Request processed in 26us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.646611:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:1.0:1789120905.646627:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120905.646670:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970605440:0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646680:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970605952:0@lo:400:kworker.0 00010000:00080000:1.0:1789120905.646717:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9e940 x1876028970606080/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120905.646728:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970606080:0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646741:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970605184:0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646752:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970605696:0@lo:400:kworker.0 00010000:00080000:1.0:1789120905.646762:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9c000 x1876028970606208/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120905.646771:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970606208:0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646850:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970605312 00000100:00100000:1.0:1789120905.646854:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970605312 00000100:00100000:1.0:1789120905.646882:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970605568 00000100:00100000:1.0:1789120905.646885:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970605568 00000100:00100000:1.0:1789120905.646910:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789120905.646917:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970605312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.646956:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970605312:12345-0@lo:400:kworker.0 Request processed in 40us (11724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.646963:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789120905.646974:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789120905.646980:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970605568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.647015:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970605568:12345-0@lo:400:kworker.0 Request processed in 36us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.647022:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1789120905.647051:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970605568:0@lo:400:kworker.0 00000100:00100000:0.0:1789120905.653335:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970605312:0@lo:400:kworker.0 00000100:00100000:0.0:1789120905.653359:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970605824:0@lo:400:kworker.0 00000100:00100000:0.0:1789120905.653468:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120905.654293:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970605824 00000100:00100000:1.0:1789120905.654304:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970605824 00000100:00100000:1.0:1789120905.654403:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789120905.654415:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970605824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120905.654493:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970605824:12345-0@lo:400:kworker.0 Request processed in 80us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120905.654501:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00010000:00080000:0.0:1789120905.654576:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9c780 x1876028970605824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120921 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120905.654590:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970605824:0@lo:400:kworker.0 00000100:00080000:2.0:1789120905.657441:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789120905.683231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120905.683333:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120905.683368:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120905.683402:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120905.683428:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120905.683726:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947452160 00000100:00100000:0.0:1789120905.683971:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947452416 00000100:00100000:0.0:1789120905.683983:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947452416 00000100:00100000:0.0:1789120905.684063:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947452032 00000100:00100000:0.0:1789120905.684067:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947452032 00000100:00100000:0.0:1789120905.684085:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947452288 00000100:00100000:0.0:1789120905.684088:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947452288 00000100:00100000:0.0:1789120905.684110:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 201 00000100:00100000:0.0:1789120905.684143:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947452416:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120905.684250:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947452416:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 110us (880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120905.684259:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 201 00000100:00100000:0.0:1789120905.684281:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 202 00000100:00100000:0.0:1789120905.684287:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947452032:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120905.684315:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947452032:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 28us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120905.684322:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 202 00000100:00100000:0.0:1789120905.684334:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 203 00000100:00100000:0.0:1789120905.684340:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947452288:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120905.684366:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947452288:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120905.684372:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 203 00000100:00100000:2.0:1789120905.686137:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947452160 00000100:00100000:2.0:1789120905.686242:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 204 00000100:00100000:2.0:1789120905.686254:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947452160:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120905.686354:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947452160:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 102us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120905.686363:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 204 00000100:00080000:2.0:1789120905.686475:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120905.686490:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789120905.691042:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947451904 00000100:00100000:3.0:1789120905.691067:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947451904 00000100:00100000:3.0:1789120905.691153:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 337 00000100:00100000:3.0:1789120905.691167:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947451904:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120905.691287:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947451904:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 122us (8073us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120905.691296:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 337 00010000:00010000:1.0:1789120905.941957:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120906.130478:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120906.130502:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970606336:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789120906.130572:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120906.135853:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970606336 00000100:00100000:3.0:1789120906.135870:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970606336 00000100:00100000:3.0:1789120906.136004:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789120906.136015:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970606336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789120906.136044:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120906.136138:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e58b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970606336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 125us (5566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120906.136145:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:0.0:1789120906.136234:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9f840 x1876028970606336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120922 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120906.136255:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970606336:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789120906.964132:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120907.992810:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120908.690239:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120908.693663:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970606464:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120908.694528:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120908.694794:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970606592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120908.694855:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120908.697228:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970606464 00000100:00100000:2.0:1789120908.697246:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970606464 00000100:00100000:2.0:1789120908.697301:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970606592 00000100:00100000:2.0:1789120908.697304:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970606592 00000100:00100000:2.0:1789120908.697325:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789120908.697340:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970606464:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789120908.697390:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120908.697475:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e58780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970606464:12345-0@lo:41:osp-pre-1-0.0 Request processed in 141us (2949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120908.698907:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789120908.698917:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789120908.698932:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970606592:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120908.698969:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789120908.699055:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970606592:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (4198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120908.699063:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1789120908.699127:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970606592:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120908.699180:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970606464:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789120909.013801:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120910.034576:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120910.738965:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970606720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120910.739055:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120910.739141:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970606720 00000100:00100000:1.0:1789120910.739150:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970606720 00000100:00100000:1.0:1789120910.739214:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789120910.739224:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970606720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120910.739260:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120910.739303:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970606720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.739311:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1789120910.739335:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789120910.739371:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783e5b0c0 x1876028970606720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120910.739394:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970606720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120910.741522:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970606848:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.741628:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.741766:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970607360:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.741803:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.741924:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970607872:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.741952:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.741985:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789120910.741991:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970606976:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.742017:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.742035:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970607488:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.742054:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.742070:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970608000:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.742090:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.742391:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970607104:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.742425:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.742445:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970607616:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.742468:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.742486:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970608128:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.742508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.742529:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789120910.742535:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970607232:0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.742943:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970607872 00000100:00100000:1.0:1789120910.742953:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970607872 00000100:00100000:1.0:1789120910.743019:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789120910.743041:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970607872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.743113:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970607872:12345-0@lo:400:kworker.0 Request processed in 85us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.743152:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789120910.743179:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970606976 00000100:00100000:1.0:1789120910.743183:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970606976 00000100:00100000:1.0:1789120910.743199:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970607488 00000100:00100000:1.0:1789120910.743202:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970607488 00000100:00100000:1.0:1789120910.743213:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970608000 00000100:00100000:1.0:1789120910.743215:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970608000 00000100:00100000:1.0:1789120910.743224:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970607616 00000100:00100000:1.0:1789120910.743226:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970607616 00000100:00100000:1.0:1789120910.743237:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970608128 00000100:00100000:1.0:1789120910.743239:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970608128 00000100:00100000:1.0:1789120910.743255:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789120910.743261:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970606976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.743294:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970606976:12345-0@lo:400:kworker.0 Request processed in 33us (1276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.743300:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1789120910.743319:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789120910.743325:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970607488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.743353:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970607488:12345-0@lo:400:kworker.0 Request processed in 29us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.743360:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789120910.743370:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789120910.743376:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970608000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.743408:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970608000:12345-0@lo:400:kworker.0 Request processed in 31us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.743414:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1789120910.743425:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789120910.743439:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970607616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.743470:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970607616:12345-0@lo:400:kworker.0 Request processed in 32us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.743477:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1789120910.743488:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789120910.743494:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970608128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.743524:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970608128:12345-0@lo:400:kworker.0 Request processed in 30us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.743542:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:1.0:1789120910.743572:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970607360 00000100:00100000:1.0:1789120910.743780:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970607360 00000100:00100000:1.0:1789120910.743814:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970607104 00000100:00100000:1.0:1789120910.743816:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970607104 00000100:00100000:1.0:1789120910.743853:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789120910.743859:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970607360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.743897:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970607360:12345-0@lo:400:kworker.0 Request processed in 38us (2094us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.743904:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789120910.743915:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789120910.743920:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970607104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.743962:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970607104:12345-0@lo:400:kworker.0 Request processed in 41us (1537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.743968:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1789120910.743985:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120910.743990:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120910.743993:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120910.744054:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970606976:0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.744076:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970607488:0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.744086:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970608000:0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.744097:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970607360:0@lo:400:kworker.0 00010000:00080000:1.0:1789120910.744111:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9f840 x1876028970607872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120910.744123:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970607872:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.744341:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.744378:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970607744:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.744410:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.744429:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970608256:0@lo:400:kworker.0 00000100:00100000:3.0:1789120910.744462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120910.744488:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970607104:0@lo:400:kworker.0 00010000:00080000:3.0:1789120910.744503:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9de00 x1876028970607616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120910.744513:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970607616:0@lo:400:kworker.0 00010000:00080000:3.0:1789120910.744525:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783c2fc00 x1876028970608128/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120910.744534:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970608128:0@lo:400:kworker.0 00000100:00100000:2.0:1789120910.745043:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970607232 00000100:00100000:2.0:1789120910.745051:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970607232 00000100:00100000:2.0:1789120910.745091:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789120910.745101:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970607232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.745113:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970607744 00000100:00100000:1.0:1789120910.745119:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970607744 00000100:00100000:1.0:1789120910.745164:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970608256 00000100:00100000:1.0:1789120910.745167:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970608256 00000100:00100000:2.0:1789120910.745182:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970607232:12345-0@lo:400:kworker.0 Request processed in 82us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120910.745191:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789120910.745193:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789120910.745202:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970607744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.745242:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970607744:12345-0@lo:400:kworker.0 Request processed in 42us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.745249:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789120910.745266:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789120910.745272:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970608256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120910.745296:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970608256:12345-0@lo:400:kworker.0 Request processed in 24us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.745303:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789120910.745323:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970607232:0@lo:400:kworker.0 00010000:00080000:2.0:1789120910.745334:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9da40 x1876028970607744/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120910.745342:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970607744:0@lo:400:kworker.0 00010000:00080000:2.0:1789120910.745351:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783c2da40 x1876028970608256/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120926 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120910.745357:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970608256:0@lo:400:kworker.0 00000100:00080000:3.0:1789120910.747321:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120910.747332:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120910.748019:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970608512:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120910.748128:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120910.748181:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120910.748188:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970608384:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120910.748213:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120910.748268:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970606848 00000100:00100000:0.0:1789120910.748277:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970606848 00000100:00100000:0.0:1789120910.748346:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789120910.748357:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970606848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120910.748416:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970606848:12345-0@lo:400:kworker.0 Request processed in 61us (6788us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120910.748424:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789120910.748483:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970608512 00000100:00100000:0.0:1789120910.748487:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970608512 00000100:00100000:0.0:1789120910.748506:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970608384 00000100:00100000:0.0:1789120910.748509:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970608384 00000100:00100000:0.0:1789120910.748523:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789120910.748530:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970608512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120910.748569:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120910.748610:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970608512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120910.748617:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789120910.748629:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789120910.748635:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970608384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789120910.748647:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120910.748671:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970608384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120910.748677:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00010000:00080000:0.0:1789120910.748746:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839ef840 x1876028970608384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120910.748773:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ef840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970608384:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789120910.748785:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467839eed00 x1876028970608512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120926 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120910.748808:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839eed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970608512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120910.750910:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970606848:0@lo:400:kworker.0 00000100:00100000:0.0:1789120910.797685:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120910.797791:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120910.797853:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120910.797880:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947452800 00000100:00100000:0.0:1789120910.797880:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120910.797894:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947452800 00000100:00100000:0.0:1789120910.797918:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120910.797946:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947453056 00000100:00100000:0.0:1789120910.797951:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947453056 00000100:00100000:1.0:1789120910.797985:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947452672 00000100:00100000:0.0:1789120910.797986:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947452928 00000100:00100000:1.0:1789120910.797990:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947452672 00000100:00100000:0.0:1789120910.797991:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947452928 00000100:00100000:3.0:1789120910.798117:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947452544 00000100:00100000:3.0:1789120910.798122:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947452544 00000100:00100000:1.0:1789120910.798151:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 211 00000100:00100000:3.0:1789120910.798159:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 339 00000100:00100000:3.0:1789120910.798172:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947452544:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120910.798182:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947452800:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120910.798252:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 212 00000100:00100000:0.0:1789120910.798263:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947453056:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120910.798270:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947452800:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 90us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.798281:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 211 00000100:00100000:1.0:1789120910.798522:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 213 00000100:00100000:2.0:1789120910.798605:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 214 00000100:00100000:2.0:1789120910.798624:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947452928:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120910.798678:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947452544:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 508us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120910.798687:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 339 00000100:00100000:1.0:1789120910.798745:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947452672:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120910.799141:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947452672:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 610us (1260us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120910.799150:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 213 00000100:00080000:1.0:1789120910.799175:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120910.799181:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789120910.799517:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947453056:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 1255us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120910.799526:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 212 00000100:00100000:2.0:1789120910.800164:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947452928:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 1536us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120910.800174:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 214 00010000:00010000:0.0:1789120911.061853:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120911.271693:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970608640:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789120911.271817:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120911.271997:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970608640 00000100:00100000:0.0:1789120911.272007:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970608640 00000100:00100000:0.0:1789120911.272079:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789120911.272092:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970608640:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120911.272140:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120911.279868:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970608640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 7761us (8036us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120911.279888:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:3.0:1789120911.281479:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783e5b0c0 x1876028970608640/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120927 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120911.281515:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970608640:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789120912.091750:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789120912.594224:0:13697:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd43c2af40 20000000:00000080:3.0:1789120912.594250:0:13697:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff946782835400 uarg=0000000000000000 20000000:01000000:3.0:1789120912.594312:0:13697:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789120912.594321:0:13697:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789120912.594329:0:13697:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:3.0:1789120912.595147:0:13698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789120912.595571:0:13697:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0000-mdtlov.enable_compr_rotational=1 in log params 00000040:00080000:2.0:1789120912.603257:0:13697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789120912.603310:0:13697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 144 off9680 00000040:00080000:2.0:1789120912.603328:0:13697:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9904 10000000:01000000:2.0:1789120912.603349:0:13697:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789120912.603376:0:13697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.603400:0:13697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468c217d600/0xb74d2367a830f461 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f45a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.603409:0:13697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f46f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f468 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.603417:0:13697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9467838d1e00/0xb74d2367a830f47d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f476 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.603424:0:13697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a2a00/0xb74d2367a830f48b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f484 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.603435:0:13697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9467838d1600/0xb74d2367a830f492 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e968 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.603443:0:13697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a3400/0xb74d2367a830f499 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e96f expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.603451:0:13697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.603528:0:13697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a3400/0xb74d2367a830f499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e96f expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.603557:0:13697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468b99a3400/0xb74d2367a830f499 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e96f expref: 12 pid: 6513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120912.603575:0:13697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970608768:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120912.604056:0:13697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9467838d1600/0xb74d2367a830f492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e968 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.604067:0:13697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9467838d1600/0xb74d2367a830f492 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e968 expref: 12 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120912.604077:0:13697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970608896:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120912.604112:0:13697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a2a00/0xb74d2367a830f48b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f484 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.604121:0:13697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468b99a2a00/0xb74d2367a830f48b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f484 expref: 23 pid: 6510 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120912.604131:0:13697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970609024:0@lo:104: 00000100:00100000:2.0:1789120912.604188:0:13697:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120912.604238:0:13697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9467838d1e00/0xb74d2367a830f47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f476 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.604247:0:13697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9467838d1e00/0xb74d2367a830f47d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f476 expref: 23 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120912.604271:0:13697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970609152:0@lo:104: 00010000:00010000:2.0:1789120912.604301:0:13697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f46f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f468 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.604308:0:13697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f46f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f468 expref: 23 pid: 6510 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120912.604316:0:13697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970609280:0@lo:104: 00010000:00010000:2.0:1789120912.604343:0:13697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468c217d600/0xb74d2367a830f461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f45a expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.604350:0:13697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468c217d600/0xb74d2367a830f461 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f45a expref: 23 pid: 6512 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120912.604357:0:13697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970609408:0@lo:104: 00000100:00100000:2.0:1789120912.604376:0:13697:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783095f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120912.604459:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789120912.604482:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120912.604512:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120912.604521:0:6501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120912.604543:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970609024 00000100:00100000:3.0:1789120912.604551:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970609024 00000100:00100000:3.0:1789120912.604603:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970609152 00000100:00100000:3.0:1789120912.604606:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970609152 00000100:00100000:3.0:1789120912.604629:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970609280 00000100:00100000:3.0:1789120912.604632:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970609280 00000100:00100000:3.0:1789120912.604642:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970609408 00000100:00100000:3.0:1789120912.604645:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970609408 00000100:00100000:3.0:1789120912.604660:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789120912.604671:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782af1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+6:13697:x1876028970609024:12345-0@lo:104: 00010000:00010000:3.0:1789120912.604698:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120912.604777:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120912.604783:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782af1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+6:13697:x1876028970609024:12345-0@lo:104: Request processed in 115us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120912.604792:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789120912.604883:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789120912.604889:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+5:13697:x1876028970609152:12345-0@lo:104: 00010000:00010000:3.0:1789120912.604907:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120912.604940:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789120912.604946:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+5:13697:x1876028970609152:12345-0@lo:104: Request processed in 58us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120912.604953:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789120912.604966:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789120912.604972:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:13697:x1876028970609280:12345-0@lo:104: 00010000:00010000:3.0:1789120912.604980:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120912.605012:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789120912.605017:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:13697:x1876028970609280:12345-0@lo:104: Request processed in 46us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120912.605023:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789120912.605036:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789120912.605041:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:13697:x1876028970609408:12345-0@lo:104: 00010000:00010000:3.0:1789120912.605049:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120912.605080:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1789120912.605085:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:13697:x1876028970609408:12345-0@lo:104: Request processed in 44us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120912.605091:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:1.0:1789120912.605169:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789120912.605180:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605188:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1800 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789120912.605192:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605201:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120912.605210:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120912.605217:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789120912.605271:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605289:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120912.605313:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605322:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f484 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f48b expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605339:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789120912.605344:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605349:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789120912.605352:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605358:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120912.605364:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120912.605369:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789120912.605383:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605389:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120912.605403:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605409:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9467838d0c00/0xb74d2367a830f476 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f47d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605424:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789120912.605427:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605432:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789120912.605435:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605442:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120912.605448:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120912.605453:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789120912.605466:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605472:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120912.605477:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605483:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a3000/0xb74d2367a830f468 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f46f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605492:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120912.605495:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605509:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22800 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789120912.605513:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605519:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120912.605526:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120912.605543:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789120912.605557:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605563:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120912.605569:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605575:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f45a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f461 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.605591:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120912.605593:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120912.605595:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120912.605614:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970609536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120912.605656:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120912.605693:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120912.605700:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970609920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120912.605733:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120912.605791:0:13697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970609024:0@lo:104: 00000100:00100000:1.0:1789120912.605800:0:13697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970609152:0@lo:104: 00000100:00100000:1.0:1789120912.605807:0:13697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970609280:0@lo:104: 00000100:00100000:1.0:1789120912.605814:0:13697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970609408:0@lo:104: 00010000:00010000:1.0:1789120912.605880:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120912.605887:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120912.605899:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120912.605913:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970609792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120912.605939:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120912.605959:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120912.605964:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970609664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120912.605987:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120912.606014:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970609536 00000100:00100000:1.0:1789120912.606020:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970609536 00010000:00010000:1.0:1789120912.606046:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a2a00/0xb74d2367a830f48b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f484 expref: 24 pid: 6510 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120912.606342:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970609920 00000100:00100000:1.0:1789120912.606346:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970609920 00010000:00010000:1.0:1789120912.606360:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468c217d600/0xb74d2367a830f461 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f45a expref: 25 pid: 6512 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120912.606370:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970609792 00000100:00100000:1.0:1789120912.606372:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970609792 00010000:00010000:1.0:1789120912.606382:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f46f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f468 expref: 26 pid: 6510 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120912.606390:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970609664 00000100:00100000:1.0:1789120912.606399:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970609664 00010000:00010000:1.0:1789120912.606412:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9467838d1e00/0xb74d2367a830f47d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f476 expref: 27 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120912.606426:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789120912.606433:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+27:3647:x1876028970609536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120912.606446:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120912.606451:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a2a00/0xb74d2367a830f48b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f484 expref: 27 pid: 6510 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.606459:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a2a00/0xb74d2367a830f48b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f484 expref: 27 pid: 6510 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.606477:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a2a00/0xb74d2367a830f48b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f484 expref: 27 pid: 6510 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.606494:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120912.606544:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+26:3647:x1876028970609536:12345-0@lo:103:ldlm_bl.0 Request processed in 99us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120912.606552:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789120912.606569:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789120912.606575:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+25:3647:x1876028970609920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120912.606583:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120912.606587:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468c217d600/0xb74d2367a830f461 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f45a expref: 25 pid: 6512 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.606595:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468c217d600/0xb74d2367a830f461 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f45a expref: 25 pid: 6512 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.606605:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217d600/0xb74d2367a830f461 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f45a expref: 25 pid: 6512 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.606623:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120912.606649:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970609920:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120912.606656:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789120912.606669:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789120912.606675:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+23:3645:x1876028970609792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120912.606697:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120912.606702:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f46f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f468 expref: 23 pid: 6510 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.606710:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f46f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f468 expref: 23 pid: 6510 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.606721:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f46f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f468 expref: 23 pid: 6510 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.606732:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120912.606760:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+22:3645:x1876028970609792:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120912.606766:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789120912.606778:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789120912.606785:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+21:3645:x1876028970609664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120912.606793:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120912.606798:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9467838d1e00/0xb74d2367a830f47d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f476 expref: 21 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.606806:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9467838d1e00/0xb74d2367a830f47d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f476 expref: 21 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.610305:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1e00/0xb74d2367a830f47d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f476 expref: 21 pid: 6513 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120912.610328:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120912.610430:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+20:3645:x1876028970609664:12345-0@lo:103:ldlm_bl.0 Request processed in 3644us (4440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120912.610439:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789120912.610526:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970609920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120912.610550:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970609536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120912.610593:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970609664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120912.610603:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970609792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120912.622802:0:13697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970608768:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789120912.623134:0:13697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7e580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13697:1876028970608896:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120912.623192:0:13697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120912.628699:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120912.629019:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947453312 00000100:00100000:3.0:1789120912.629032:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947453312 00010000:00010000:3.0:1789120912.629110:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9467838d1600/0xb74d2367a830f492 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e968 expref: 13 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120912.629262:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:3.0:1789120912.629274:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947453312:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120912.629295:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120912.629302:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9467838d1600/0xb74d2367a830f492 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e968 expref: 13 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120912.629315:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9467838d1600/0xb74d2367a830f492 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e968 expref: 13 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120912.629339:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1600/0xb74d2367a830f492 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e968 expref: 13 pid: 6512 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120912.629360:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120912.629438:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:75b5d71e-0e31-479d-b240-b6a98d05b974+12:2412:x1876028947453312:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 166us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120912.629447:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:1.0:1789120912.638478:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120912.639085:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947453184 00000100:00100000:2.0:1789120912.639103:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947453184 00010000:00010000:2.0:1789120912.639171:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a3400/0xb74d2367a830f499 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e96f expref: 12 pid: 6513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120912.639223:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:2.0:1789120912.639235:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:2411:x1876028947453184:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120912.639254:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120912.639260:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a3400/0xb74d2367a830f499 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e96f expref: 12 pid: 6513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639297:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a3400/0xb74d2367a830f499 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e96f expref: 12 pid: 6513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639322:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3400/0xb74d2367a830f499 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e96f expref: 12 pid: 6513 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639345:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639355:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639374:0:6503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639382:0:6503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639391:0:6503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639400:0:6503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639406:0:6503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789120912.639411:0:6503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639419:0:6503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639457:0:6503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120912.639472:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120912.639563:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75b5d71e-0e31-479d-b240-b6a98d05b974+11:2411:x1876028947453184:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 328us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120912.639572:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00010000:00010000:0.0:1789120912.641005:0:13697:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120912.641025:0:13697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120912.641032:0:13697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0000/0xb74d2367a830f4a0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.106270:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120913.810551:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970610048:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120913.810628:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120913.810773:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970610048 00000100:00100000:2.0:1789120913.810781:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970610048 00000100:00100000:2.0:1789120913.810855:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789120913.810865:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970610048:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789120913.810904:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120913.810958:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970610048:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.810966:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789120913.811012:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970610048:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120913.811647:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970610176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120913.811701:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120913.812190:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970610176 00000100:00100000:2.0:1789120913.812197:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970610176 00000100:00100000:3.0:1789120913.812361:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789120913.812370:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970610176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120913.812398:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789120913.812468:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970610176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120913.812475:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789120913.812558:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970610176:0@lo:41:osp-pre-0-1.0 10000000:01000000:3.0:1789120913.938589:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789120913.938597:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946782aee800 from 7 10000000:01000000:3.0:1789120913.938602:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789120913.938667:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120913.938680:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120913.938690:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120913.938716:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970610304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789120913.938781:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120913.938862:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9d82180 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.943882:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970610304 00000100:00100000:0.0:1789120913.943896:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970610304 00000100:00100000:0.0:1789120913.943969:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789120913.943979:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970610304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120913.943996:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120913.944017:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e23800/0xb74d2367a830f4ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f4a7 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.944042:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e23800/0xb74d2367a830f4ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f4a7 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.944054:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e23800/0xb74d2367a830f4ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f4a7 expref: 21 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.944063:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23800, rc 0) 00000100:00100000:0.0:1789120913.944134:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970610304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (5352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.944153:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:3.0:1789120913.945360:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970610304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120913.945384:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120913.945393:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120913.945477:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970610432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120913.945536:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120913.945581:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9d82180 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.946946:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970610432 00000100:00100000:0.0:1789120913.946956:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970610432 00000100:00100000:0.0:1789120913.947013:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789120913.947023:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970610432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.947195:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970610432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 173us (1658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.947202:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:1.0:1789120913.947332:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970610432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120913.947381:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970610560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120913.947450:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120913.947489:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.947858:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970610560 00000100:00100000:0.0:1789120913.947863:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970610560 00000100:00100000:0.0:1789120913.947901:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:0.0:1789120913.947910:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970610560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.951123:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970610560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3205us (3663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.951136:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789120913.951245:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970610560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120913.953024:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13758:1876028970610688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120913.953113:0:13758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120913.953157:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030300 going to sleep for 11 seconds 00000100:00100000:3.0:1789120913.953265:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970610688 00000100:00100000:3.0:1789120913.953273:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970610688 00000100:00100000:3.0:1789120913.953324:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:3.0:1789120913.953333:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:13758:x1876028970610688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120913.953466:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:13758:x1876028970610688:12345-0@lo:502:llog_process_th.0 Request processed in 131us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120913.953482:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1789120913.954142:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13758:1876028970610688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120913.954171:0:13758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120913.954179:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120913.954181:0:13758:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789120913.954189:0:13758:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946782aee800 00000020:00000080:2.0:1789120913.954195:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789120913.954265:0:13758:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13758:1876028970610816:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120913.954296:0:13758:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120913.954319:0:13758:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030300 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.954640:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970610816 00000100:00100000:0.0:1789120913.954645:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970610816 00000100:00100000:0.0:1789120913.954690:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:0.0:1789120913.954697:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:13758:x1876028970610816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120913.954788:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:13758:x1876028970610816:12345-0@lo:502:llog_process_th.0 Request processed in 91us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.954795:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1789120913.956988:0:13758:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13758:1876028970610816:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120913.957032:0:13758:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120913.957166:0:13758:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120913.957169:0:13758:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789120913.957178:0:13758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789120913.959358:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789120913.959399:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120913.959411:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.959435:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120913.959446:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789120913.959449:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468b9991000 from 7 10000000:01000000:0.0:1789120913.959452:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120913.959488:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.959496:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.959506:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.959544:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b07840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970610944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.959610:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.959649:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467832373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.959669:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970610944 00000100:00100000:0.0:1789120913.959674:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970610944 00000100:00100000:0.0:1789120913.959716:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789120913.959726:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970610944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120913.959738:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120913.959751:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e22e00/0xb74d2367a830f4bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f4b5 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.959773:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e22e00/0xb74d2367a830f4bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f4b5 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.959794:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e22e00/0xb74d2367a830f4bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f4b5 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.959802:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22e00, rc 0) 00000100:00100000:0.0:1789120913.959869:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970610944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.959876:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:0.0:1789120913.959923:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b07840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970610944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120913.959935:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.959944:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.959994:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b07840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970611072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.960019:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.960034:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467832373c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120913.960432:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970611072 00000100:00100000:2.0:1789120913.960447:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970611072 00000100:00100000:2.0:1789120913.960473:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1789120913.960483:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970611072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120913.960623:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970611072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 142us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.960630:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1789120913.961460:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b07840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970611072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120913.961505:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970611200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120913.961569:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120913.961600:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.962461:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970611200 00000100:00100000:0.0:1789120913.962469:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970611200 00000100:00100000:0.0:1789120913.962537:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789120913.962547:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970611200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.962676:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970611200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.962684:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1789120913.962861:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970611200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120913.964571:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13760:1876028970611328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120913.964653:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120913.964699:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2600 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.964804:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970611328 00000100:00100000:0.0:1789120913.964810:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970611328 00000100:00100000:0.0:1789120913.964876:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789120913.964882:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:13760:x1876028970611328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120913.964980:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:13760:x1876028970611328:12345-0@lo:502:llog_process_th.0 Request processed in 98us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.964985:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1789120913.966670:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13760:1876028970611328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120913.966710:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120913.966723:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.966725:0:13760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789120913.966732:0:13760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468b9991000 00000020:00000080:3.0:1789120913.966735:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120913.967242:0:13760:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13760:1876028970611456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120913.967310:0:13760:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120913.967343:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970611456 00000100:00100000:3.0:1789120913.967348:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970611456 00000100:00100000:3.0:1789120913.967387:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789120913.967394:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:13760:x1876028970611456:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120913.967506:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:13760:x1876028970611456:12345-0@lo:502:llog_process_th.0 Request processed in 111us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120913.967513:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1789120913.967571:0:13760:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9d82540 going to sleep for 11 seconds 00000100:00100000:3.0:1789120913.967585:0:13760:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13760:1876028970611456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120913.967605:0:13760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120913.967610:0:13760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120913.967612:0:13760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789120913.967616:0:13760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789120913.967857:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789120913.967884:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120913.967896:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.967908:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120913.967919:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789120913.967922:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946883582800 from 7 10000000:01000000:0.0:1789120913.967925:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120913.967951:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.967959:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.967967:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.967980:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970611584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.968013:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120913.968117:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970611584 00000100:00100000:1.0:1789120913.968123:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970611584 00000100:00100000:1.0:1789120913.968152:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1789120913.968158:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970611584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120913.968168:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120913.968179:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a3e00/0xb74d2367a830f4ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f4c3 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.968198:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3e00/0xb74d2367a830f4ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f4c3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.968221:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a3e00/0xb74d2367a830f4ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f4c3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.968230:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3e00, rc 0) 00000100:00100000:1.0:1789120913.968267:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970611584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.968273:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789120913.968362:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467832373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.968378:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970611584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120913.968399:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.968409:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.968596:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970611712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.968622:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.968645:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467832373c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120913.968696:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970611712 00000100:00100000:1.0:1789120913.968700:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970611712 00000100:00100000:1.0:1789120913.968729:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1789120913.969324:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970611712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120913.969423:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970611712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 689us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.969428:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789120913.970637:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970611712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.970678:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970611840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.970736:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.970770:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467832373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120913.972586:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970611840 00000100:00100000:3.0:1789120913.972599:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970611840 00000100:00100000:3.0:1789120913.972649:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789120913.972658:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970611840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120913.972816:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970611840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (2079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120913.972843:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1789120913.974449:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970611840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120913.975295:0:13762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13762:1876028970611968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120913.975369:0:13762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120913.975414:0:13762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.975470:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970611968 00000100:00100000:0.0:1789120913.975476:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970611968 00000100:00100000:0.0:1789120913.975536:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1789120913.975546:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:13762:x1876028970611968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120913.975668:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:13762:x1876028970611968:12345-0@lo:502:llog_process_th.0 Request processed in 122us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.975676:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1789120913.975816:0:13762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13762:1876028970611968:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120913.975880:0:13762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120913.975890:0:13762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120913.975893:0:13762:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789120913.975903:0:13762:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946883582800 00000020:00000080:2.0:1789120913.975906:0:13762:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789120913.975977:0:13762:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13762:1876028970612096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120913.976013:0:13762:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120913.976032:0:13762:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830300c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120913.976232:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970612096 00000100:00100000:0.0:1789120913.976237:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970612096 00000100:00100000:0.0:1789120913.976280:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:0.0:1789120913.976288:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:13762:x1876028970612096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120913.976354:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:13762:x1876028970612096:12345-0@lo:502:llog_process_th.0 Request processed in 66us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120913.976371:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1789120913.977098:0:13762:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13762:1876028970612096:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120913.977139:0:13762:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120913.977146:0:13762:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120913.977148:0:13762:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789120913.977155:0:13762:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789120913.978492:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789120913.978556:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789120913.978570:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.978586:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789120913.978600:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789120913.978603:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946886899000 from 7 10000000:01000000:0.0:1789120913.978606:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789120913.978653:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.978661:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.978671:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.978693:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970612224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.978760:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.978809:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237540 going to sleep for 11 seconds 00000100:00100000:1.0:1789120913.978966:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970612224 00000100:00100000:1.0:1789120913.978973:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970612224 00000100:00100000:1.0:1789120913.979029:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:1.0:1789120913.979039:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970612224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120913.979052:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120913.979066:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a3c00/0xb74d2367a830f4d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f4d1 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.979091:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3c00/0xb74d2367a830f4d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f4d1 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.979101:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a3c00/0xb74d2367a830f4d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f4d1 expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.979129:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3c00, rc 0) 00000100:00100000:1.0:1789120913.979168:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970612224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.979175:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:0.0:1789120913.981632:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970612224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120913.981659:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120913.981673:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120913.981771:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970612352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.981851:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.981887:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120913.982056:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970612352 00000100:00100000:2.0:1789120913.982063:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970612352 00000100:00100000:2.0:1789120913.982113:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1789120913.982122:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970612352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120913.982244:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970612352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.982264:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:0.0:1789120913.982391:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970612352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.982420:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970612480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.982471:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.982498:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237540 going to sleep for 11 seconds 00000100:00100000:1.0:1789120913.982550:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970612480 00000100:00100000:1.0:1789120913.982554:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970612480 00000100:00100000:1.0:1789120913.982587:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1789120913.982594:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970612480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120913.982683:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970612480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.982690:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:0.0:1789120913.982844:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970612480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120913.983222:0:13763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13763:1876028970612608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789120913.983270:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120913.983296:0:13763:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237300 going to sleep for 11 seconds 00000100:00100000:1.0:1789120913.983373:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970612608 00000100:00100000:1.0:1789120913.983378:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970612608 00000100:00100000:1.0:1789120913.983413:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789120913.983420:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:13763:x1876028970612608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120913.983527:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:13763:x1876028970612608:12345-0@lo:502:llog_process_th.0 Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120913.983534:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1789120913.983602:0:13763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13763:1876028970612608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120913.983626:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120913.983636:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120913.983638:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789120913.983649:0:13763:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946886899000 00000020:00000080:2.0:1789120913.983651:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789120913.983733:0:13763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13763:1876028970612736:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120913.983767:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120913.983786:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970612736 00000100:00100000:2.0:1789120913.983789:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970612736 00000100:00100000:2.0:1789120913.983809:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789120913.983814:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:13763:x1876028970612736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120913.983902:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:13763:x1876028970612736:12345-0@lo:502:llog_process_th.0 Request processed in 87us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120913.983909:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1789120913.983947:0:13763:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120913.983960:0:13763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:13763:1876028970612736:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120913.983980:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120913.983984:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120913.983985:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789120913.983990:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789120913.984534:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789120913.984555:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789120913.984564:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120913.984575:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120914.132142:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120914.448986:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120914.453761:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947453440 00000100:00100000:2.0:1789120914.453777:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947453440 00000100:00100000:2.0:1789120914.453873:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 360 00000100:00100000:2.0:1789120914.453884:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+11:6186:x1876028947453440:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120914.453902:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120914.453921:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0400/0xb74d2367a830f4df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e976 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120914.453950:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0400/0xb74d2367a830f4df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e976 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120914.453961:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0400/0xb74d2367a830f4df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e976 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120914.453970:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0400, rc 0) 00000100:00100000:2.0:1789120914.454045:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947453440:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 163us (5070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120914.454052:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 360 00000100:00100000:2.0:1789120914.457786:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120914.458876:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947453568 00000100:00100000:0.0:1789120914.458888:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947453568 00000100:00100000:0.0:1789120914.458960:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 361 00000100:00100000:0.0:1789120914.458971:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947453568:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120914.459134:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947453568:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 164us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120914.459142:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 361 00000100:00100000:0.0:1789120914.466180:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120914.466289:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947453696 00000100:00100000:1.0:1789120914.466306:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947453696 00000100:00100000:1.0:1789120914.466365:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 362 00000100:00100000:1.0:1789120914.466376:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947453696:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120914.466657:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947453696:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 282us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120914.466673:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 362 00000100:00100000:1.0:1789120914.474689:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120914.479360:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947453824 00000100:00100000:2.0:1789120914.479373:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947453824 00000100:00100000:2.0:1789120914.479648:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 363 00000100:00100000:2.0:1789120914.479660:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:10360:x1876028947453824:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789120914.479817:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:10360:x1876028947453824:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 160us (5138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120914.479841:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 363 00000100:00100000:2.0:1789120914.490647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120914.490765:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947453952 00000100:00100000:0.0:1789120914.490774:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947453952 00000100:00100000:0.0:1789120914.490859:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 364 00000100:00100000:0.0:1789120914.490870:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:10360:x1876028947453952:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120914.491035:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:10360:x1876028947453952:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 165us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120914.491044:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 364 00000100:00100000:0.0:1789120914.510220:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120914.512287:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947454080 00000100:00100000:2.0:1789120914.512314:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947454080 00000100:00100000:2.0:1789120914.512400:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 365 00000100:00100000:2.0:1789120914.512411:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947454080:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120914.512436:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120914.512456:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f4e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e97d expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120914.512484:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f4e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e97d expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120914.512495:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f4e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e97d expref: 13 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120914.512504:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0c00, rc 0) 00000100:00100000:2.0:1789120914.512589:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947454080:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 179us (2379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120914.512596:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 365 00000100:00100000:2.0:1789120914.516713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120914.522184:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947454208 00000100:00100000:0.0:1789120914.522201:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947454208 00000100:00100000:0.0:1789120914.522290:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 366 00000100:00100000:0.0:1789120914.522302:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947454208:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120914.523103:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947454208:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 800us (6394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120914.523114:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 366 00000100:00100000:3.0:1789120914.540545:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120914.540971:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947454336 00000100:00100000:1.0:1789120914.540985:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947454336 00000100:00100000:1.0:1789120914.541055:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 367 00000100:00100000:1.0:1789120914.541067:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947454336:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120914.541238:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947454336:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 173us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120914.541247:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 367 00000100:00100000:1.0:1789120914.554219:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120914.555226:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947454464 00000100:00100000:2.0:1789120914.555239:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947454464 00000100:00100000:2.0:1789120914.555322:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 368 00000100:00100000:2.0:1789120914.555332:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:10363:x1876028947454464:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789120914.555543:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:10363:x1876028947454464:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 210us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120914.555551:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 368 00000100:00100000:2.0:1789120914.567796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120914.568005:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947454592 00000100:00100000:0.0:1789120914.568015:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947454592 00000100:00100000:0.0:1789120914.568070:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 369 00000100:00100000:0.0:1789120914.568082:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:10363:x1876028947454592:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120914.568240:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:10363:x1876028947454592:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 160us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120914.568249:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 369 00010000:00010000:2.0:1789120915.160107:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120915.858010:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120915.858034:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970612864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120915.858370:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970612992:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.858435:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120915.858487:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970613504:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.858523:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120915.858543:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970614016:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.858579:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120915.858597:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970614528:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.858630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120915.858660:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789120915.858667:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970613120:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.858693:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120915.858711:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970613632:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.858731:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120915.858748:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970614144:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.858768:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120915.858802:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970612992 00000100:00100000:1.0:1789120915.858808:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970612992 00000100:00100000:1.0:1789120915.858870:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789120915.858879:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970612992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.858925:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970612992:12345-0@lo:400:kworker.0 Request processed in 47us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.858933:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:1.0:1789120915.858966:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970613504 00000100:00100000:1.0:1789120915.858969:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970613504 00000100:00100000:1.0:1789120915.858997:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789120915.859003:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970613504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.859038:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970613504:12345-0@lo:400:kworker.0 Request processed in 35us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.859044:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789120915.859061:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970614016 00000100:00100000:1.0:1789120915.859064:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970614016 00000100:00100000:1.0:1789120915.859122:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970614528 00000100:00100000:1.0:1789120915.859126:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970614528 00000100:00100000:1.0:1789120915.859145:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789120915.859151:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970614016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.859181:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970614016:12345-0@lo:400:kworker.0 Request processed in 31us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.859187:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789120915.859197:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789120915.859203:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970614528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.859230:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970614528:12345-0@lo:400:kworker.0 Request processed in 27us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.859236:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789120915.859257:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970613120 00000100:00100000:1.0:1789120915.859261:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970613120 00000100:00100000:1.0:1789120915.859286:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970613632 00000100:00100000:1.0:1789120915.859289:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970613632 00000100:00100000:1.0:1789120915.859304:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970614144 00000100:00100000:1.0:1789120915.859307:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970614144 00000100:00100000:1.0:1789120915.859321:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789120915.859326:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970613120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.859355:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970613120:12345-0@lo:400:kworker.0 Request processed in 29us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.859362:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1789120915.859372:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789120915.859378:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970613632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.859399:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970613632:12345-0@lo:400:kworker.0 Request processed in 22us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.859414:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:1.0:1789120915.859425:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1789120915.859431:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970614144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.859457:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970614144:12345-0@lo:400:kworker.0 Request processed in 26us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.859463:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00080000:1.0:1789120915.859493:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120915.859498:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120915.859508:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120915.859553:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970613120:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.859570:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970613632:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.859582:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970614144:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.859592:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970612992:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.859603:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970613504:0@lo:400:kworker.0 00010000:00080000:1.0:1789120915.859618:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf703480 x1876028970614016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120915.859630:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf703480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970614016:0@lo:400:kworker.0 00010000:00080000:1.0:1789120915.859640:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d3c00 x1876028970614528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120915.859648:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970614528:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.859689:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120915.859698:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970614656:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120915.859734:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120915.859766:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970614656 00000100:00100000:1.0:1789120915.859770:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970614656 00000100:00100000:1.0:1789120915.859799:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789120915.859806:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970614656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120915.859869:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120915.859906:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970614656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.859913:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1789120915.859942:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b04f00 x1876028970614656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120915.859963:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970614656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120915.860011:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120915.860054:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970613248:0@lo:400:kworker.0 00000100:00100000:3.0:1789120915.860081:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120915.860100:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970613760:0@lo:400:kworker.0 00000100:00100000:3.0:1789120915.860125:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120915.860143:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970614272:0@lo:400:kworker.0 00000100:00100000:3.0:1789120915.860164:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120915.860179:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970614784:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789120915.860229:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970612864 00000100:00100000:1.0:1789120915.860233:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970612864 00000100:00100000:1.0:1789120915.860256:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789120915.860263:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970612864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120915.860277:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120915.860305:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970612864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.860312:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789120915.860384:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970613376:0@lo:400:kworker.0 00000100:00100000:2.0:1789120915.860416:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120915.860442:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970613888:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.860458:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970613760 00000100:00100000:1.0:1789120915.860463:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970613760 00000100:00100000:2.0:1789120915.860468:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120915.860491:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970614400:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.860511:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970614272 00000100:00100000:1.0:1789120915.860516:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970614272 00000100:00100000:2.0:1789120915.860529:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120915.860538:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970613376 00000100:00100000:1.0:1789120915.860542:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970613376 00000100:00100000:1.0:1789120915.860561:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1789120915.860575:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970613760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120915.860588:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970613248 00000100:00100000:2.0:1789120915.860594:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970613248 00000100:00100000:1.0:1789120915.860611:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970613760:12345-0@lo:400:kworker.0 Request processed in 36us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.860619:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1789120915.860633:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789120915.860638:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789120915.860656:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970613248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120915.860692:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970613248:12345-0@lo:400:kworker.0 Request processed in 50us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120915.860698:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789120915.860707:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970614272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120915.860734:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1789120915.860744:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970613376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.860749:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970614272:12345-0@lo:400:kworker.0 Request processed in 101us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.860756:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1789120915.860785:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970613888 00000100:00100000:1.0:1789120915.860789:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970613888 00000100:00100000:2.0:1789120915.860799:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970613376:12345-0@lo:400:kworker.0 Request processed in 56us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120915.860808:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1789120915.860844:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970614400 00000100:00100000:1.0:1789120915.860848:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970614400 00000100:00100000:2.0:1789120915.860876:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970613376:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.860879:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789120915.860889:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970613888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.860936:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970613888:12345-0@lo:400:kworker.0 Request processed in 47us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.860943:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789120915.860955:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789120915.860961:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970614400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.860991:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970614400:12345-0@lo:400:kworker.0 Request processed in 31us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.860997:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1789120915.861018:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120915.861021:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120915.861023:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1789120915.861046:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf700000 x1876028970613888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120915.861064:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf700000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970613888:0@lo:400:kworker.0 00010000:00080000:1.0:1789120915.861077:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d0f00 x1876028970614400/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120915.861162:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970614400:0@lo:400:kworker.0 00000100:00100000:3.0:1789120915.861384:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789120915.861418:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9e940 x1876028970612864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120915.861429:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970614784 00000100:00100000:3.0:1789120915.861434:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970612864:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120915.861435:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970614784 00000100:00100000:3.0:1789120915.861466:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970613248:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.861470:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00010000:00080000:3.0:1789120915.861482:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783e592c0 x1876028970613760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120915.861483:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970614784:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120915.861512:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970613760:0@lo:400:kworker.0 00002000:00000024:1.0:1789120915.861515:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:3.0:1789120915.861528:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b93480 x1876028970614272/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120931 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120915.861545:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970614272:0@lo:400:kworker.0 00000100:00100000:1.0:1789120915.861554:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970614784:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (169us total) trans 0 rc 0/0 00010000:00080000:3.0:1789120915.861561:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b05a40 x1876028970614784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120931 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120915.861563:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789120915.861579:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970614784:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120915.923590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120915.923692:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120915.923719:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120915.923744:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120915.923756:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120915.923907:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947454976 00000100:00100000:1.0:1789120915.923915:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947454976 00000100:00100000:1.0:1789120915.923978:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947455232 00000100:00100000:1.0:1789120915.923982:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947455232 00000100:00100000:1.0:1789120915.923995:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947454848 00000100:00100000:1.0:1789120915.923997:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947454848 00000100:00100000:1.0:1789120915.924009:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947455104 00000100:00100000:1.0:1789120915.924011:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947455104 00000100:00100000:1.0:1789120915.924025:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 221 00000100:00100000:1.0:1789120915.924035:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783eca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947454976:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120915.924118:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783eca940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947454976:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 84us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.924126:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 221 00000100:00100000:1.0:1789120915.924147:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 222 00000100:00100000:1.0:1789120915.924151:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947455232:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120915.924177:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947455232:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.924182:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 222 00000100:00100000:1.0:1789120915.924193:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 223 00000100:00100000:1.0:1789120915.924199:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2409:x1876028947454848:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120915.924217:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2409:x1876028947454848:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 20us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.924221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 223 00000100:00100000:1.0:1789120915.924229:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 224 00000100:00100000:1.0:1789120915.924232:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947455104:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120915.924243:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947455104:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 11us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120915.924246:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 224 00000100:00080000:3.0:1789120915.924294:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789120915.924298:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789120915.924841:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947454720 00000100:00100000:2.0:1789120915.924846:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947454720 00000100:00100000:2.0:1789120915.924930:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 371 00000100:00100000:2.0:1789120915.924939:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2409:x1876028947454720:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120915.924985:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2409:x1876028947454720:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 46us (1438us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120915.924990:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 371 00010000:00010000:1.0:1789120916.179276:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120916.377588:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120916.377618:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970614912:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789120916.377716:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120916.377777:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970614912 00000100:00100000:1.0:1789120916.377784:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970614912 00000100:00100000:1.0:1789120916.377856:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789120916.377865:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970614912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789120916.377890:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120916.377949:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970614912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120916.377974:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1789120916.378019:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5ed00 x1876028970614912/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120932 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120916.378037:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970614912:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789120917.206421:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120918.226116:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120918.933954:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970615040:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120918.934032:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120918.934095:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970615040 00000100:00100000:1.0:1789120918.934102:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970615040 00000100:00100000:1.0:1789120918.934141:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789120918.934149:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970615040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789120918.934183:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120918.934225:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970615040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120918.934233:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789120918.934275:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970615040:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120918.936566:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970615168:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789120918.936666:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120918.936976:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970615168 00000100:00100000:3.0:1789120918.936983:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970615168 00000100:00100000:3.0:1789120918.937035:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789120918.937044:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970615168:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120918.937077:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789120918.937128:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970615168:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120918.937135:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789120918.937180:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970615168:0@lo:41:osp-pre-0-1.0 00000020:00000080:3.0:1789120919.251085:0:13996:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf68ff470 20000000:00000080:3.0:1789120919.251102:0:13996:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9468b9b0d400 uarg=0000000000000000 20000000:01000000:3.0:1789120919.251142:0:13996:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789120919.251148:0:13996:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1' 20000000:01000000:3.0:1789120919.251161:0:13996:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 del=0 00000040:00080000:0.0:1789120919.253413:0:13997:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:1.0:1789120919.253865:0:13996:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.lod.lustre-MDT0001-mdtlov.enable_compr_rotational=1 in log params 00010000:00010000:2.0:1789120919.257557:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789120919.263712:0:13996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10128 00000040:00080000:1.0:1789120919.263749:0:13996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 144 off10272 00000040:00080000:1.0:1789120919.263764:0:13996:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10496 10000000:01000000:1.0:1789120919.263779:0:13996:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789120919.263798:0:13996:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.263816:0:13996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946783e23800/0xb74d2367a830f4ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f4a7 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.264076:0:13996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946783e22e00/0xb74d2367a830f4bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f4b5 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.264083:0:13996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a3e00/0xb74d2367a830f4ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f4c3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.264089:0:13996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a3c00/0xb74d2367a830f4d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f4d1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.264098:0:13996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9467838d0400/0xb74d2367a830f4df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e976 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.264104:0:13996:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f4e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e97d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.264112:0:13996:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.264149:0:13996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f4e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e97d expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.264163:0:13996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f4e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e97d expref: 12 pid: 6510 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120919.264176:0:13996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615296:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120919.264275:0:13996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9467838d0400/0xb74d2367a830f4df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e976 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.264284:0:13996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9467838d0400/0xb74d2367a830f4df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e976 expref: 12 pid: 6510 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120919.264300:0:13996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615424:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120919.264335:0:13996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a3c00/0xb74d2367a830f4d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f4d1 expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.264342:0:13996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468b99a3c00/0xb74d2367a830f4d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f4d1 expref: 23 pid: 6513 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120919.264350:0:13996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf700000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615552:0@lo:104: 00000100:00100000:1.0:1789120919.269523:0:13996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120919.269625:0:13996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a3e00/0xb74d2367a830f4ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f4c3 expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.269641:0:13996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468b99a3e00/0xb74d2367a830f4ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f4c3 expref: 23 pid: 6510 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120919.269656:0:13996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615680:0@lo:104: 00000100:00100000:1.0:1789120919.269698:0:13996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789120919.269769:0:13996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946783e22e00/0xb74d2367a830f4bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f4b5 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.269778:0:13996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946783e22e00/0xb74d2367a830f4bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f4b5 expref: 23 pid: 6512 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120919.269787:0:13996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615808:0@lo:104: 00000100:00100000:1.0:1789120919.269808:0:13996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120919.272285:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00010000:00010000:1.0:1789120919.272941:0:13996:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946783e23800/0xb74d2367a830f4ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f4a7 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.272976:0:13996:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff946783e23800/0xb74d2367a830f4ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f4a7 expref: 23 pid: 6512 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120919.272990:0:13996:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615936:0@lo:104: 00000100:00100000:1.0:1789120919.273036:0:13996:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120919.273087:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120919.273118:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947455488 00000100:00100000:0.0:1789120919.273125:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947455488 00010000:00010000:0.0:1789120919.273160:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9467838d0400/0xb74d2367a830f4df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e976 expref: 13 pid: 6510 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120919.273198:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947455360 00000100:00100000:0.0:1789120919.273201:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947455360 00010000:00010000:0.0:1789120919.273214:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f4e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e97d expref: 14 pid: 6510 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120919.273232:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:0.0:1789120919.273241:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+14:2412:x1876028947455488:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120919.273254:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120919.273260:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9467838d0400/0xb74d2367a830f4df lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e976 expref: 14 pid: 6510 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120919.273270:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9467838d0400/0xb74d2367a830f4df lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e976 expref: 14 pid: 6510 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120919.273302:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120919.273342:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835ec050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+14:2412:x1876028947455488:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 102us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120919.273350:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:0.0:1789120919.273404:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:0.0:1789120919.273411:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947455360:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120919.273420:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120919.273424:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f4e6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e97d expref: 13 pid: 6510 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120919.273435:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f4e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e97d expref: 13 pid: 6510 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120919.273455:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120919.273486:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b070c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947455360:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 75us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120919.273493:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:3.0:1789120919.274673:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970615552 00000100:00100000:3.0:1789120919.274683:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970615552 00000100:00100000:3.0:1789120919.274728:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970615680 00000100:00100000:3.0:1789120919.274732:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970615680 00000100:00100000:3.0:1789120919.274750:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970615808 00000100:00100000:3.0:1789120919.274753:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970615808 00000100:00100000:3.0:1789120919.274770:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789120919.274779:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf703480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+5:13996:x1876028970615552:12345-0@lo:104: 00010000:00010000:3.0:1789120919.274795:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.274898:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120919.274903:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf703480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+5:13996:x1876028970615552:12345-0@lo:104: Request processed in 127us (5389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120919.274910:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789120919.274932:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789120919.274938:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:13996:x1876028970615680:12345-0@lo:104: 00010000:00010000:3.0:1789120919.274945:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.274980:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789120919.274984:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+4:13996:x1876028970615680:12345-0@lo:104: Request processed in 48us (5287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120919.274990:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789120919.275003:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789120919.275008:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:13996:x1876028970615808:12345-0@lo:104: 00010000:00010000:3.0:1789120919.275016:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275074:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789120919.275080:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e58000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:13996:x1876028970615808:12345-0@lo:104: Request processed in 72us (5270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120919.275086:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:3.0:1789120919.275122:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789120919.275128:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275135:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22800 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789120919.275140:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275148:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120919.275155:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120919.275161:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789120919.275203:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275210:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120919.275232:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275238:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783e22800/0xb74d2367a830f4d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4d8 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275260:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789120919.275263:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275269:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789120919.275272:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275279:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120919.275286:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120919.275291:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789120919.275305:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275311:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120919.275317:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275324:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783e22400/0xb74d2367a830f4c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4ca expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275333:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120919.275335:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275352:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22600 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789120919.275355:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275362:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120919.275368:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120919.275385:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789120919.275403:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275408:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120919.275421:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275428:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783e22600/0xb74d2367a830f4b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4bc expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275437:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120919.275439:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120919.275440:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120919.275446:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120919.275451:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120919.275463:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970616064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789120919.275511:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120919.275552:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120919.275565:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970616192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789120919.275588:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120919.275617:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970616320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789120919.275639:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120919.275672:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970616064 00000100:00100000:3.0:1789120919.275676:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970616064 00010000:00010000:3.0:1789120919.275695:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a3c00/0xb74d2367a830f4d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f4d1 expref: 24 pid: 6513 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120919.275715:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970616192 00000100:00100000:3.0:1789120919.275718:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970616192 00010000:00010000:3.0:1789120919.275729:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a3e00/0xb74d2367a830f4ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f4c3 expref: 25 pid: 6510 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120919.275743:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970616320 00000100:00100000:3.0:1789120919.275746:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970616320 00010000:00010000:3.0:1789120919.275756:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946783e22e00/0xb74d2367a830f4bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f4b5 expref: 26 pid: 6512 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120919.275768:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789120919.275773:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783eca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+26:3644:x1876028970616064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120919.275783:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120919.275787:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a3c00/0xb74d2367a830f4d8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f4d1 expref: 26 pid: 6513 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275797:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a3c00/0xb74d2367a830f4d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f4d1 expref: 26 pid: 6513 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275815:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120919.275869:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783eca580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+26:3644:x1876028970616064:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120919.275883:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789120919.275898:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789120919.275904:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+25:3644:x1876028970616192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120919.275912:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120919.275917:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a3e00/0xb74d2367a830f4ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f4c3 expref: 25 pid: 6510 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275925:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a3e00/0xb74d2367a830f4ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f4c3 expref: 25 pid: 6510 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.275937:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120919.275960:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecbc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+25:3644:x1876028970616192:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120919.275966:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789120919.275978:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789120919.275984:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970616320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120919.275991:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120919.275995:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946783e22e00/0xb74d2367a830f4bc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f4b5 expref: 24 pid: 6512 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.276003:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946783e22e00/0xb74d2367a830f4bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f4b5 expref: 24 pid: 6512 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120919.276011:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120919.276035:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970616320:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120919.276042:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789120919.276080:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970616320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789120919.276111:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970616192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789120919.276119:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ecb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970616064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120919.276802:0:13996:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120919.276905:0:6501:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789120919.276920:0:6501:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970615936 00000100:00100000:2.0:1789120919.276924:0:6501:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970615936 00000100:00100000:2.0:1789120919.276966:0:6501:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789120919.276975:0:6501:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782834c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:13996:x1876028970615936:12345-0@lo:104: 00010000:00010000:2.0:1789120919.276986:0:6501:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.277036:0:6501:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789120919.277042:0:6501:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782834c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:03a1864a-46e4-4762-8a00-3ced97b06903+3:13996:x1876028970615936:12345-0@lo:104: Request processed in 70us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120919.277048:0:6501:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:2.0:1789120919.277087:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120919.277093:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.277100:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217c000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120919.277113:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.277120:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120919.277128:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120919.277134:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120919.277165:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.277171:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120919.277184:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.277191:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a830f4a7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f4ae expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.277208:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120919.277210:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120919.277212:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120919.277339:0:13996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f4e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e97d expref: 12 pid: 6510 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120919.277352:0:13996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615296:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120919.277389:0:13996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0400/0xb74d2367a830f4df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e976 expref: 11 pid: 6510 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120919.277399:0:13996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615424:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120919.277411:0:13996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3c00/0xb74d2367a830f4d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f4d1 expref: 23 pid: 6513 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120919.277418:0:13996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf700000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615552:0@lo:104: 00010000:00010000:1.0:1789120919.277428:0:13996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3e00/0xb74d2367a830f4ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f4c3 expref: 22 pid: 6510 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120919.277435:0:13996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615680:0@lo:104: 00010000:00010000:1.0:1789120919.277445:0:13996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e22e00/0xb74d2367a830f4bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f4b5 expref: 21 pid: 6512 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120919.277453:0:13996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615808:0@lo:104: 00000100:00100000:1.0:1789120919.277461:0:13996:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13996:1876028970615936:0@lo:104: 00010000:00010000:1.0:1789120919.277508:0:13996:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120919.277755:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970616448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789120919.277792:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120919.277902:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970616448 00000100:00100000:2.0:1789120919.277908:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970616448 00010000:00010000:2.0:1789120919.277929:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946783e23800/0xb74d2367a830f4ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f4a7 expref: 21 pid: 6512 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120919.277959:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789120919.277965:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+21:3647:x1876028970616448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120919.277977:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120919.277988:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946783e23800/0xb74d2367a830f4ae lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f4a7 expref: 21 pid: 6512 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.277999:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946783e23800/0xb74d2367a830f4ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f4a7 expref: 21 pid: 6512 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.278012:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e23800/0xb74d2367a830f4ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f4a7 expref: 21 pid: 6512 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.278024:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.278032:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.278045:0:10341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.278052:0:10341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.278059:0:10341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.278064:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.278069:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789120919.278073:0:10341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.278080:0:10341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.278103:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120919.278111:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120919.278141:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+20:3647:x1876028970616448:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120919.278148:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789120919.278208:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970616448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120919.278843:0:13996:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.278853:0:13996:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120919.278860:0:13996:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3200/0xb74d2367a830f4ed lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13996 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.274937:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120920.398005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120920.398176:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947455616 00000100:00100000:1.0:1789120920.398185:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947455616 00000100:00100000:1.0:1789120920.398244:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 372 00000100:00100000:1.0:1789120920.398254:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+11:6186:x1876028947455616:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120920.398282:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120920.398303:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a2800/0xb74d2367a830f4f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e984 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.398330:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a2800/0xb74d2367a830f4f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e984 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.398341:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a2800/0xb74d2367a830f4f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e984 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.398350:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2800, rc 0) 00000100:00100000:1.0:1789120920.398420:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947455616:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 168us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120920.398445:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 372 10000000:01000000:1.0:1789120920.401920:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789120920.401929:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946782aee800 from 10 10000000:01000000:1.0:1789120920.401935:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789120920.401984:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.401995:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120920.402004:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120920.402029:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970616576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120920.402100:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120920.402158:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120920.402315:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970616576 00000100:00100000:2.0:1789120920.402323:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970616576 00000100:00100000:2.0:1789120920.402384:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:2.0:1789120920.402394:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970616576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120920.402407:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120920.402420:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1200/0xb74d2367a830f502 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f4fb expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.402443:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1200/0xb74d2367a830f502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f4fb expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.402456:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1200/0xb74d2367a830f502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f4fb expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.402475:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1200, rc 0) 00000100:00100000:2.0:1789120920.402530:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970616576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.402538:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1789120920.402649:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e5b0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970616576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120920.402664:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.402673:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120920.402742:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970616704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.402771:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.402795:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120920.403088:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970616704 00000100:00100000:2.0:1789120920.403094:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970616704 00000100:00100000:2.0:1789120920.403144:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:2.0:1789120920.403151:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970616704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120920.403263:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970616704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.403270:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1789120920.403446:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120920.403516:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947455744 00000100:00100000:2.0:1789120920.403520:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947455744 00000100:00100000:2.0:1789120920.403541:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 375 00000100:00100000:2.0:1789120920.403547:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947455744:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120920.403736:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947455744:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 187us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.403743:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 375 00000100:00100000:3.0:1789120920.403852:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970616704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.403889:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970616832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.403932:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.403966:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120920.404131:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970616832 00000100:00100000:2.0:1789120920.404135:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970616832 00000100:00100000:2.0:1789120920.404165:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789120920.404172:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970616832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120920.404252:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970616832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 80us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.404259:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1789120920.405162:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970616832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.408626:0:14057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14057:1876028970616960:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120920.408725:0:14057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.408775:0:14057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120920.409019:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970616960 00000100:00100000:2.0:1789120920.409029:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970616960 00000100:00100000:2.0:1789120920.409089:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:2.0:1789120920.409099:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:14057:x1876028970616960:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120920.409234:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:14057:x1876028970616960:12345-0@lo:502:llog_process_th.0 Request processed in 136us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.409241:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:3.0:1789120920.412184:0:14057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14057:1876028970616960:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120920.412240:0:14057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120920.412253:0:14057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120920.412255:0:14057:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789120920.412264:0:14057:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946782aee800 00000020:00000080:3.0:1789120920.412267:0:14057:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120920.412384:0:14057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14057:1876028970617088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120920.412467:0:14057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.412512:0:14057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120920.416576:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970617088 00000100:00100000:2.0:1789120920.416590:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970617088 00000100:00100000:2.0:1789120920.416672:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:2.0:1789120920.416682:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:14057:x1876028970617088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120920.416887:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:14057:x1876028970617088:12345-0@lo:502:llog_process_th.0 Request processed in 205us (4429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.416895:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1789120920.417082:0:14057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14057:1876028970617088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120920.417117:0:14057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120920.417126:0:14057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120920.417128:0:14057:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789120920.417134:0:14057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789120920.417392:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789120920.417428:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120920.417438:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.417450:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120920.417469:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120920.417472:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468b9991000 from 10 10000000:01000000:2.0:1789120920.417475:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120920.417506:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.417515:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.417524:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120920.417544:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970617216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120920.417585:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120920.419571:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783118780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120920.424709:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970617216 00000100:00100000:3.0:1789120920.424726:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970617216 00000100:00100000:3.0:1789120920.424800:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789120920.424810:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970617216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120920.424844:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120920.424863:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f510 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f509 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.424892:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f509 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.424902:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f509 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.424927:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217cc00, rc 0) 00000100:00100000:3.0:1789120920.425007:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970617216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 198us (7421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.425014:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:3.0:1789120920.425079:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970617216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120920.425097:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.425106:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120920.425179:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970617344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.425212:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.425241:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789120920.425254:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970617344 00000100:00100000:3.0:1789120920.425257:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970617344 00000100:00100000:3.0:1789120920.425276:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789120920.425283:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970617344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.427670:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970617344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2378us (2448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.427685:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1789120920.427767:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970617344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.427838:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970617472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.427887:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.427915:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789120920.427932:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970617472 00000100:00100000:3.0:1789120920.427937:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970617472 00000100:00100000:3.0:1789120920.427969:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789120920.427977:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970617472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.428076:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970617472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.428084:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1789120920.428122:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970617472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.428304:0:14060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14060:1876028970617600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120920.428338:0:14060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.428356:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970617600 00000100:00100000:3.0:1789120920.428360:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970617600 00000100:00100000:2.0:1789120920.428529:0:14060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789120920.431943:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789120920.431957:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:14060:x1876028970617600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120920.432111:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:14060:x1876028970617600:12345-0@lo:502:llog_process_th.0 Request processed in 156us (3771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.432118:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1789120920.433473:0:14060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14060:1876028970617600:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120920.433512:0:14060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120920.433522:0:14060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120920.433524:0:14060:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789120920.433532:0:14060:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468b9991000 00000020:00000080:3.0:1789120920.433535:0:14060:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120920.433763:0:14060:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14060:1876028970617728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120920.433840:0:14060:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.433882:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970617728 00000100:00100000:3.0:1789120920.433887:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970617728 00000100:00100000:3.0:1789120920.433924:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789120920.433932:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:14060:x1876028970617728:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120920.434025:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:14060:x1876028970617728:12345-0@lo:502:llog_process_th.0 Request processed in 92us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.434032:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00000100:00100000:3.0:1789120920.434083:0:14060:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789120920.434096:0:14060:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14060:1876028970617728:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120920.434113:0:14060:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120920.434117:0:14060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120920.434119:0:14060:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789120920.434123:0:14060:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789120920.434181:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789120920.434200:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789120920.434211:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.434221:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120920.434233:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789120920.434235:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946883582800 from 10 10000000:01000000:3.0:1789120920.434238:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789120920.434263:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.434271:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.434291:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120920.434306:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970617856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.434334:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.434348:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7480 going to sleep for 11 seconds 00000100:00100000:3.0:1789120920.436853:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970617856 00000100:00100000:3.0:1789120920.436867:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970617856 00000100:00100000:3.0:1789120920.436935:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789120920.436945:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970617856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120920.436961:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120920.436979:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c217d600/0xb74d2367a830f51e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f517 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.437011:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217d600/0xb74d2367a830f51e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f517 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.437023:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c217d600/0xb74d2367a830f51e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f517 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.437030:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d600, rc 0) 00000100:00100000:3.0:1789120920.437106:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970617856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (2771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.437113:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1789120920.437169:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970617856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120920.437189:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.437207:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120920.437282:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970617984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.437314:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.437340:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789120920.437515:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970617984 00000100:00100000:1.0:1789120920.437520:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970617984 00000100:00100000:1.0:1789120920.437547:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789120920.437554:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970617984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120920.437752:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970617984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120920.437759:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1789120920.437791:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970617984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120920.437842:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970618112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120920.437883:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120920.437910:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120920.437921:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970618112 00000100:00100000:1.0:1789120920.437925:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970618112 00000100:00100000:1.0:1789120920.437942:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789120920.437948:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970618112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120920.438024:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970618112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120920.438031:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:1.0:1789120920.438069:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970618112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120920.440484:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120920.440860:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947455872 00000100:00100000:1.0:1789120920.440868:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947455872 00000100:00100000:1.0:1789120920.440928:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 387 00000100:00100000:1.0:1789120920.440938:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947455872:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120920.441067:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947455872:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 131us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120920.441076:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 387 00000100:00100000:1.0:1789120920.443992:0:14061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14061:1876028970618240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120920.444071:0:14061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120920.444112:0:14061:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120920.444213:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970618240 00000100:00100000:3.0:1789120920.444220:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970618240 00000100:00100000:3.0:1789120920.444264:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789120920.444272:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:14061:x1876028970618240:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120920.444403:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:14061:x1876028970618240:12345-0@lo:502:llog_process_th.0 Request processed in 131us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.444411:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:2.0:1789120920.444557:0:14061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14061:1876028970618240:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120920.444587:0:14061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120920.444596:0:14061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120920.444599:0:14061:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789120920.444615:0:14061:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946883582800 00000020:00000080:2.0:1789120920.444618:0:14061:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789120920.444702:0:14061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14061:1876028970618368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120920.444742:0:14061:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120920.444766:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970618368 00000100:00100000:2.0:1789120920.444770:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970618368 00000100:00100000:2.0:1789120920.444793:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789120920.444799:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:14061:x1876028970618368:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120920.444894:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:14061:x1876028970618368:12345-0@lo:502:llog_process_th.0 Request processed in 94us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.444901:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1789120920.444926:0:14061:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783118780 going to sleep for 11 seconds 00000100:00100000:2.0:1789120920.444936:0:14061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14061:1876028970618368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120920.444953:0:14061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120920.444957:0:14061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120920.444958:0:14061:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:2.0:1789120920.444962:0:14061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789120920.445223:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:3.0:1789120920.445248:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789120920.445257:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.445268:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120920.445279:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789120920.445281:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946886899000 from 10 10000000:01000000:3.0:1789120920.445285:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789120920.445310:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.445318:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120920.445335:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120920.445349:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970618496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.445391:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.445410:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7600 going to sleep for 11 seconds 00000100:00100000:2.0:1789120920.445755:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970618496 00000100:00100000:2.0:1789120920.445761:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970618496 00000100:00100000:2.0:1789120920.445781:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789120920.445787:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970618496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120920.445801:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120920.445812:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f52c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f525 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.445852:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f52c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f525 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.445863:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f52c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f525 expref: 24 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.445872:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0c00, rc 0) 00000100:00100000:2.0:1789120920.445905:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970618496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.445912:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:2.0:1789120920.445941:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970618496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120920.445953:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.445962:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120920.446008:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970618624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120920.446031:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120920.446042:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120920.446051:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970618624 00000100:00100000:2.0:1789120920.446053:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970618624 00000100:00100000:2.0:1789120920.446066:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789120920.446071:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970618624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120920.446164:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970618624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.446171:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789120920.446193:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970618624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120920.446217:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970618752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120920.446247:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120920.446257:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468812ed540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120920.446266:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970618752 00000100:00100000:2.0:1789120920.446269:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970618752 00000100:00100000:2.0:1789120920.446285:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1789120920.446291:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970618752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120920.446355:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970618752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.447450:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:2.0:1789120920.447524:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970618752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.448644:0:14062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14062:1876028970618880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120920.448714:0:14062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.448757:0:14062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120920.449009:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970618880 00000100:00100000:1.0:1789120920.449016:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970618880 00000100:00100000:1.0:1789120920.449058:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1789120920.449067:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:14062:x1876028970618880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120920.449180:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:14062:x1876028970618880:12345-0@lo:502:llog_process_th.0 Request processed in 114us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120920.449187:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00000100:00100000:3.0:1789120920.451086:0:14062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14062:1876028970618880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120920.451125:0:14062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120920.451136:0:14062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120920.451139:0:14062:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:3.0:1789120920.451148:0:14062:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946886899000 00000020:00000080:3.0:1789120920.451150:0:14062:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120920.451246:0:14062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14062:1876028970619008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120920.451315:0:14062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.451352:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970619008 00000100:00100000:3.0:1789120920.451357:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970619008 00000100:00100000:3.0:1789120920.451414:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789120920.451423:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:14062:x1876028970619008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120920.451543:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:14062:x1876028970619008:12345-0@lo:502:llog_process_th.0 Request processed in 120us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.451551:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:3.0:1789120920.451601:0:14062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f73c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120920.451635:0:14062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec83c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14062:1876028970619008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120920.451654:0:14062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120920.451659:0:14062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120920.451661:0:14062:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000040:00080000:3.0:1789120920.451664:0:14062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1789120920.452087:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-12 (rc=0) 10000000:01000000:2.0:1789120920.452112:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120920.452124:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120920.452135:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120920.466547:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120920.466716:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947456000 00000100:00100000:3.0:1789120920.466726:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947456000 00000100:00100000:3.0:1789120920.467496:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 395 00000100:00100000:3.0:1789120920.467510:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:10420:x1876028947456000:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789120920.467675:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:10420:x1876028947456000:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 169us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.467685:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 395 00000100:00100000:3.0:1789120920.477013:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120920.477057:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947456128 00000100:00100000:3.0:1789120920.477066:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947456128 00000100:00100000:3.0:1789120920.477114:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 396 00000100:00100000:3.0:1789120920.477124:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:10420:x1876028947456128:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789120920.477267:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:10420:x1876028947456128:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 144us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.477276:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 396 00000100:00100000:3.0:1789120920.489679:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120920.489771:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947456256 00000100:00100000:0.0:1789120920.489781:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947456256 00000100:00100000:0.0:1789120920.489877:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 397 00000100:00100000:0.0:1789120920.489888:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947456256:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120920.489906:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120920.489927:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e23600/0xb74d2367a830f533 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e98b expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120920.489960:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e23600/0xb74d2367a830f533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e98b expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120920.489972:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e23600/0xb74d2367a830f533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e98b expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120920.489981:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23600, rc 0) 00000100:00100000:0.0:1789120920.490043:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947456256:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 157us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120920.490049:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 397 00000100:00100000:2.0:1789120920.494492:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120920.494558:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947456384 00000100:00100000:3.0:1789120920.494567:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947456384 00000100:00100000:3.0:1789120920.494628:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 398 00000100:00100000:3.0:1789120920.494638:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947456384:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120920.494799:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947456384:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 162us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.494844:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 398 00000100:00100000:3.0:1789120920.509081:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120920.509199:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947456512 00000100:00100000:1.0:1789120920.509210:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947456512 00000100:00100000:1.0:1789120920.509258:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 399 00000100:00100000:1.0:1789120920.509267:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947456512:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120920.509430:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947456512:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 163us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120920.509438:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 399 00000100:00100000:2.0:1789120920.524153:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120920.525266:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947456640 00000100:00100000:0.0:1789120920.525277:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947456640 00000100:00100000:0.0:1789120920.525346:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 400 00000100:00100000:0.0:1789120920.525381:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:10423:x1876028947456640:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789120920.525550:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:10423:x1876028947456640:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 184us (1407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120920.525559:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 400 00000100:00100000:2.0:1789120920.537962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120920.538107:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947456768 00000100:00100000:3.0:1789120920.538117:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947456768 00000100:00100000:3.0:1789120920.538179:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 401 00000100:00100000:3.0:1789120920.538190:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:10423:x1876028947456768:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789120920.538329:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:10423:x1876028947456768:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 140us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.538339:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 401 00000100:00100000:2.0:1789120920.978259:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120920.978284:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970619136:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789120920.978364:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120920.978526:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970619136 00000100:00100000:0.0:1789120920.978533:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970619136 00000100:00100000:0.0:1789120920.978595:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789120920.978606:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970619136:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789120920.978644:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120920.978696:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970619136:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120920.978704:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00010000:00080000:0.0:1789120920.978745:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b06580 x1876028970619136/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120920.978772:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970619136:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789120920.978941:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120920.979966:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120920.979980:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970619264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120920.980024:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.980299:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970619520:0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.980331:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.980348:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970620032:0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.980367:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.980379:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970620544:0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.980398:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.980416:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789120920.980421:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970619392:0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.980450:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.980483:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ecb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970619904:0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.980510:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.980528:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970620416:0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.980550:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120920.980575:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970619520 00000100:00100000:3.0:1789120920.980580:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970619520 00000100:00100000:3.0:1789120920.980635:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970620032 00000100:00100000:3.0:1789120920.980639:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970620032 00000100:00100000:3.0:1789120920.980661:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970620544 00000100:00100000:3.0:1789120920.980663:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970620544 00000100:00100000:3.0:1789120920.980674:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970620416 00000100:00100000:3.0:1789120920.980676:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970620416 00000100:00100000:3.0:1789120920.980690:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789120920.980697:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970619520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.980747:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970619520:12345-0@lo:400:kworker.0 Request processed in 50us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.980754:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1789120920.980770:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789120920.980776:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970620032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.980801:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970620032:12345-0@lo:400:kworker.0 Request processed in 25us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.980807:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789120920.980841:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789120920.980859:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970620544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.980887:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970620544:12345-0@lo:400:kworker.0 Request processed in 40us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.980893:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789120920.980905:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789120920.980911:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970620416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.980933:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970620416:12345-0@lo:400:kworker.0 Request processed in 23us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.980939:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789120920.980958:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970619904 00000100:00100000:3.0:1789120920.980966:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970619904 00000100:00100000:3.0:1789120920.980991:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789120920.980997:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970619904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.981029:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970619904:12345-0@lo:400:kworker.0 Request processed in 33us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.981035:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:3.0:1789120920.981061:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120920.981065:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120920.981090:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ecb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970619904:0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.981100:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970620416:0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.981108:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970619520:0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.981117:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970620032:0@lo:400:kworker.0 00010000:00080000:3.0:1789120920.981126:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d1f480 x1876028970620544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120920.981135:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970620544:0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.981163:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970619392 00000100:00100000:3.0:1789120920.981166:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970619392 00000100:00100000:3.0:1789120920.981190:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1789120920.981197:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970619392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120920.981229:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970619392:12345-0@lo:400:kworker.0 Request processed in 34us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120920.981235:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00000100:00100000:3.0:1789120920.981263:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970619392:0@lo:400:kworker.0 00000100:00100000:2.0:1789120920.981494:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ecb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970619776:0@lo:400:kworker.0 00000100:00100000:2.0:1789120920.981524:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120920.981549:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970620288:0@lo:400:kworker.0 00000100:00100000:2.0:1789120920.981569:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120920.981585:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789120920.981591:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970619648:0@lo:400:kworker.0 00000100:00100000:2.0:1789120920.981609:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120920.981637:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970620160:0@lo:400:kworker.0 00000100:00100000:2.0:1789120920.981657:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120920.981672:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970620672:0@lo:400:kworker.0 00000100:00100000:2.0:1789120920.981691:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120920.981716:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970619648 00000100:00100000:2.0:1789120920.981719:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970619648 00000100:00100000:2.0:1789120920.981746:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789120920.981753:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970619648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120920.981790:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970619648:12345-0@lo:400:kworker.0 Request processed in 37us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.981796:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789120920.981811:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970619776 00000100:00100000:2.0:1789120920.981814:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970619776 00000100:00100000:2.0:1789120920.981869:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970620160 00000100:00100000:2.0:1789120920.981872:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970620160 00000100:00100000:2.0:1789120920.981902:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789120920.981907:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970619776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120920.981937:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970619776:12345-0@lo:400:kworker.0 Request processed in 30us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.981943:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1789120920.981953:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789120920.981959:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970620160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120920.981982:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970620160:12345-0@lo:400:kworker.0 Request processed in 23us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120920.981988:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:2.0:1789120920.982002:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789120920.982021:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970619648:0@lo:400:kworker.0 00010000:00080000:2.0:1789120920.982031:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783ec9680 x1876028970620160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120920.982040:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970620160:0@lo:400:kworker.0 00000100:00100000:2.0:1789120920.982048:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ecb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970619776:0@lo:400:kworker.0 00000100:00100000:1.0:1789120920.982511:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970620288 00000100:00100000:1.0:1789120920.982516:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970620288 00000100:00100000:1.0:1789120920.982564:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970620672 00000100:00100000:1.0:1789120920.982568:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970620672 00000100:00100000:1.0:1789120920.982592:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789120920.982599:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970620288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120920.982655:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970620288:12345-0@lo:400:kworker.0 Request processed in 57us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120920.982662:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789120920.982675:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789120920.982681:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970620672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120920.982709:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970620672:12345-0@lo:400:kworker.0 Request processed in 28us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120920.982715:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00010000:00080000:1.0:1789120920.982757:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d1de00 x1876028970620672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120920.982768:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970620672:0@lo:400:kworker.0 00010000:00080000:1.0:1789120920.982792:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783ec9e00 x1876028970620288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120936 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120920.982801:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970620288:0@lo:400:kworker.0 00000100:00100000:0.0:1789120920.983214:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120920.983224:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970620800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120920.983266:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120920.983297:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970619264 00000100:00100000:0.0:1789120920.983300:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970619264 00000100:00100000:0.0:1789120920.983318:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970620800 00000100:00100000:0.0:1789120920.983320:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970620800 00000100:00100000:0.0:1789120920.983330:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789120920.983335:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970619264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120920.983355:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120920.983391:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970619264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (3366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120920.983404:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789120920.983418:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789120920.983424:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970620800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120920.983434:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120920.983471:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970620800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120920.983477:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00080000:0.0:1789120920.983500:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b06580 x1876028970620800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120920.983513:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b06580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970620800:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1789120920.983525:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783e592c0 x1876028970619264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120936 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120920.983535:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970619264:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789120920.983737:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120920.983741:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120921.037788:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120921.037873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120921.037909:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120921.037945:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120921.037971:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120921.038134:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947457152 00000100:00100000:1.0:1789120921.038143:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947457152 00000100:00100000:1.0:1789120921.038211:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947457408 00000100:00100000:1.0:1789120921.038215:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947457408 00000100:00100000:1.0:1789120921.038231:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947457024 00000100:00100000:1.0:1789120921.038234:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947457024 00000100:00100000:1.0:1789120921.038246:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947457280 00000100:00100000:1.0:1789120921.038248:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947457280 00000100:00100000:1.0:1789120921.038277:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 231 00000100:00100000:1.0:1789120921.038287:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947457152:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120921.038376:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947457152:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 90us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120921.038384:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 231 00000100:00100000:1.0:1789120921.038404:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 232 00000100:00100000:1.0:1789120921.038411:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947457408:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120921.038438:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf700000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947457408:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120921.038444:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 232 00000100:00100000:1.0:1789120921.038472:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 233 00000100:00100000:1.0:1789120921.038479:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947457024:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120921.038505:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf703480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947457024:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120921.038530:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 233 00000100:00100000:1.0:1789120921.038544:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 234 00000100:00100000:1.0:1789120921.038551:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947457280:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120921.038579:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947457280:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120921.038585:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 234 00000100:00100000:0.0:1789120921.039076:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947456896 00000100:00100000:0.0:1789120921.039082:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947456896 00000100:00100000:0.0:1789120921.039128:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 403 00000100:00100000:0.0:1789120921.039136:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947456896:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120921.039165:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947456896:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 31us (1394us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120921.039172:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 403 00000100:00080000:2.0:1789120921.039399:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120921.039403:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789120921.298282:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120921.490070:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970620928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789120921.490144:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120921.490289:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970620928 00000100:00100000:2.0:1789120921.490309:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970620928 00000100:00100000:2.0:1789120921.490381:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789120921.490389:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970620928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789120921.490413:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120921.494123:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970620928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 2202us (2446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120921.494137:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00010000:00080000:3.0:1789120921.494265:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783e592c0 x1876028970620928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120937 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120921.494290:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e592c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970620928:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789120922.322200:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120923.347360:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120924.050390:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120924.050455:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970621056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120924.050554:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120924.050945:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970621056 00000100:00100000:3.0:1789120924.050956:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970621056 00000100:00100000:3.0:1789120924.051030:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789120924.051042:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970621056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120924.051088:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789120924.051162:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970621056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 122us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120924.051170:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789120924.051309:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970621056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120924.051945:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf662580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970621184:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120924.051997:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120924.052391:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970621184 00000100:00100000:2.0:1789120924.052399:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970621184 00000100:00100000:2.0:1789120924.052462:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789120924.052472:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970621184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789120924.052510:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120924.052574:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970621184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120924.052582:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789120924.052669:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf662580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970621184:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789120924.369952:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120925.393979:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120926.098101:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120926.098127:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970621312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120926.098201:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120926.098362:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970621312 00000100:00100000:1.0:1789120926.098369:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970621312 00000100:00100000:1.0:1789120926.098438:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789120926.098450:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970621312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120926.098481:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120926.098533:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970621312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.098541:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789120926.098582:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120926.098591:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970621440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120926.098620:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789120926.098652:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120926.098662:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970621440 00000100:00100000:1.0:1789120926.098666:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970621440 00000100:00100000:1.0:1789120926.098689:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789120926.098696:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970621440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120926.098712:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120926.098745:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970621440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.098767:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1789120926.098782:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789120926.098809:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783e58000 x1876028970621440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120926.098848:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970621440:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789120926.098879:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b05a40 x1876028970621312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120926.098890:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b05a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970621312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120926.099284:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970621696:0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.099319:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120926.099338:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970622208:0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.099361:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120926.099376:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970622720:0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.099423:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120926.099445:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1789120926.099450:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970621824:0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.099474:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120926.099491:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970622336:0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.099508:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120926.099519:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970622848:0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.099541:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120926.099579:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970621696 00000100:00100000:1.0:1789120926.099583:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970621696 00000100:00100000:1.0:1789120926.099618:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970622208 00000100:00100000:1.0:1789120926.099621:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970622208 00000100:00100000:1.0:1789120926.099637:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970622720 00000100:00100000:1.0:1789120926.099639:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970622720 00000100:00100000:1.0:1789120926.099649:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970622336 00000100:00100000:1.0:1789120926.099651:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970622336 00000100:00100000:1.0:1789120926.099664:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789120926.099669:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970621696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.099708:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970621696:12345-0@lo:400:kworker.0 Request processed in 38us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.099714:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1789120926.099728:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789120926.099734:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970622208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.099758:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970622208:12345-0@lo:400:kworker.0 Request processed in 25us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.099764:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789120926.099774:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789120926.099780:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970622720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.099804:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970622720:12345-0@lo:400:kworker.0 Request processed in 24us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.099809:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789120926.099838:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789120926.099845:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970622336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.099872:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970622336:12345-0@lo:400:kworker.0 Request processed in 28us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.099877:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789120926.099901:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970621824 00000100:00100000:1.0:1789120926.099911:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970621824 00000100:00100000:1.0:1789120926.099936:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789120926.099942:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970621824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.099974:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebf0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970621824:12345-0@lo:400:kworker.0 Request processed in 32us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.099980:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789120926.099998:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970622848 00000100:00100000:1.0:1789120926.100001:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970622848 00000100:00100000:1.0:1789120926.100026:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789120926.100032:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970622848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.100063:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970622848:12345-0@lo:400:kworker.0 Request processed in 30us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.100068:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1789120926.100088:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120926.100091:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120926.100093:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120926.100117:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970621824:0@lo:400:kworker.0 00010000:00080000:1.0:1789120926.100130:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9cb40 x1876028970622336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120926.100139:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970622336:0@lo:400:kworker.0 00010000:00080000:1.0:1789120926.100148:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9de00 x1876028970622848/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120926.100156:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970622848:0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.100167:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970621696:0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.100175:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970622208:0@lo:400:kworker.0 00010000:00080000:1.0:1789120926.100193:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9e940 x1876028970622720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120926.100201:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970622720:0@lo:400:kworker.0 00000100:00100000:0.0:1789120926.100373:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970621952:0@lo:400:kworker.0 00000100:00100000:0.0:1789120926.100416:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120926.100446:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970622464:0@lo:400:kworker.0 00000100:00100000:0.0:1789120926.100470:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120926.100500:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789120926.100506:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970621568:0@lo:400:kworker.0 00000100:00100000:0.0:1789120926.100536:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120926.100554:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970622080:0@lo:400:kworker.0 00000100:00100000:0.0:1789120926.100588:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120926.100603:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970622592:0@lo:400:kworker.0 00000100:00100000:0.0:1789120926.100625:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120926.100759:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970621952 00000100:00100000:3.0:1789120926.100764:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970621952 00000100:00100000:3.0:1789120926.100801:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970622592 00000100:00100000:3.0:1789120926.100804:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970622592 00000100:00100000:3.0:1789120926.100848:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789120926.100855:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970621952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120926.100897:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970621952:12345-0@lo:400:kworker.0 Request processed in 43us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120926.100903:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789120926.100917:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789120926.100922:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970622592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120926.100956:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b05a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970622592:12345-0@lo:400:kworker.0 Request processed in 34us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120926.100963:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789120926.100986:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970621568 00000100:00100000:3.0:1789120926.100990:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970621568 00000100:00100000:3.0:1789120926.101016:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1789120926.101022:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970621568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120926.101048:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970621568:12345-0@lo:400:kworker.0 Request processed in 27us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120926.101053:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:3.0:1789120926.101078:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970622080 00000100:00100000:3.0:1789120926.101082:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970622080 00000100:00100000:3.0:1789120926.101104:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789120926.101110:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970622080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120926.101141:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970622080:12345-0@lo:400:kworker.0 Request processed in 31us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120926.101147:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1789120926.101164:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120926.101190:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970621568:0@lo:400:kworker.0 00000100:00100000:3.0:1789120926.101200:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970622080:0@lo:400:kworker.0 00000100:00100000:3.0:1789120926.101210:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970622592:0@lo:400:kworker.0 00000100:00100000:3.0:1789120926.101218:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970621952:0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.101476:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970622464 00000100:00100000:1.0:1789120926.101480:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970622464 00000100:00100000:1.0:1789120926.101519:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789120926.101526:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970622464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.101882:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970622464:12345-0@lo:400:kworker.0 Request processed in 357us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.101891:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1789120926.102151:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120926.102159:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120926.102172:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970622976:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120926.102217:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789120926.102270:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9f0c0 x1876028970622464/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120926.102282:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970622464:0@lo:400:kworker.0 00000100:00100000:1.0:1789120926.103968:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970622976 00000100:00100000:1.0:1789120926.103980:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970622976 00000100:00100000:1.0:1789120926.104029:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789120926.104037:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970622976:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789120926.104063:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120926.104131:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970622976:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.104138:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00010000:00080000:2.0:1789120926.105342:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468938eb480 x1876028970622976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120926.105368:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970622976:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789120926.162641:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120926.162686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120926.162716:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120926.162751:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120926.162793:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120926.162949:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947457536 00000100:00100000:1.0:1789120926.162958:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947457536 00000100:00100000:1.0:1789120926.163011:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 405 00000100:00100000:1.0:1789120926.163021:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947457536:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120926.163090:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947457536:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 70us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.163098:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 405 00000100:00100000:3.0:1789120926.164687:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947457792 00000100:00100000:3.0:1789120926.164708:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947457792 00000100:00100000:3.0:1789120926.164943:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947458048 00000100:00100000:3.0:1789120926.164948:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947458048 00000100:00080000:1.0:1789120926.165803:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789120926.166153:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947457664 00000100:00100000:1.0:1789120926.166163:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947457664 00000100:00100000:1.0:1789120926.166214:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947457920 00000100:00100000:1.0:1789120926.166217:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947457920 00000100:00100000:1.0:1789120926.166244:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 241 00000100:00100000:1.0:1789120926.166257:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947457792:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120926.166454:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947457792:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 199us (3766us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.166464:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 241 00000100:00100000:1.0:1789120926.166503:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 242 00000100:00100000:1.0:1789120926.166511:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947457664:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120926.166874:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947457664:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 362us (4119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.166881:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 242 00000100:00100000:1.0:1789120926.166900:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 243 00000100:00100000:1.0:1789120926.166907:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947457920:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120926.166935:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947457920:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 30us (4143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.166942:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 243 00000100:00080000:1.0:1789120926.166963:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120926.170197:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 244 00000100:00100000:3.0:1789120926.170218:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947458048:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120926.170338:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947458048:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 126us (7619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120926.170347:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 244 00010000:00010000:3.0:1789120926.418034:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120926.614098:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120926.614123:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970623104:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789120926.615100:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120926.615341:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970623104 00000100:00100000:1.0:1789120926.615351:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970623104 00000100:00100000:1.0:1789120926.615420:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789120926.615431:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970623104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789120926.615456:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120926.615528:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970623104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120926.615536:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:3.0:1789120926.615618:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783ebcf00 x1876028970623104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120942 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120926.615638:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970623104:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1789120926.692964:0:14199:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 06:02:04 (1789120924) === 00010000:00010000:2.0:1789120927.447679:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120928.474272:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120928.984695:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120928.984766:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120928.985197:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947458176 00000100:00100000:1.0:1789120928.985210:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947458176 00000100:00100000:1.0:1789120928.985303:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:1.0:1789120928.985318:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2409:x1876028947458176:12345-192.168.202.32@tcp:41:mkdir.0 00000004:00000024:1.0:1789120928.985370:0:11088:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789120928.985493:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2409:x1876028947458176:12345-192.168.202.32@tcp:41:mkdir.0 Request processed in 180us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120928.985499:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:1.0:1789120928.985530:0:6528:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947458304 00000100:00100000:1.0:1789120928.985533:0:6528:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947458304 00000100:00100000:1.0:1789120928.985549:0:6528:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:1.0:1789120928.985553:0:6528:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:10793:x1876028947458304:12345-192.168.202.32@tcp:700:mkdir.0 00000100:00100000:1.0:1789120928.985579:0:6528:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:10793:x1876028947458304:12345-192.168.202.32@tcp:700:mkdir.0 Request processed in 25us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120928.985584:0:6528:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00080000:1.0:1789120928.986459:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120928.994232:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120928.996208:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947458560 00000100:00100000:2.0:1789120928.996248:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947458560 00000100:00100000:2.0:1789120928.996542:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:2.0:1789120928.996556:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:10793:x1876028947458560:12345-192.168.202.32@tcp:36:mkdir.0 00010000:00010000:2.0:1789120928.996640:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120928.998020:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830f342 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8e3 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120928.998051:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946888a7fc00) 00010000:00010000:2.0:1789120928.998066:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120928.998166:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f53a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120928.998180:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f53a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120928.998190:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f53a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120928.999067:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120928.999082:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120928.999090:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002223:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002246:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002266:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120929.002287:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004892c566 reply state 000000001fd34c1e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002299:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002306:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff946893a10400) 00010000:00010000:2.0:1789120929.002309:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789120929.002314:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789120929.002320:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789120929.002328:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f53a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002334:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f53a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002341:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f53a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002346:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120929.002351:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f53a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002358:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f53a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002368:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946893a10c00) 00010000:00010000:2.0:1789120929.002371:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120929.002393:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f53a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002400:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f53a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120929.002421:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004892c566 reply state 000000001fd34c1e transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002431:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.002438:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff946893a10600) 00010000:00010000:2.0:1789120929.002440:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789120929.002442:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789120929.002560:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:10793:x1876028947458560:12345-192.168.202.32@tcp:36:mkdir.0 Request processed in 6003us (8339us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789120929.002570:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:1.0:1789120929.019908:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120929.020004:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947458688 00000100:00100000:2.0:1789120929.020020:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947458688 00000100:00100000:2.0:1789120929.020104:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:2.0:1789120929.020117:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:10794:x1876028947458688:12345-192.168.202.32@tcp:101:chmod.0 00010000:00010000:2.0:1789120929.020139:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120929.020162:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f54f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e992 expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.020244:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f556 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.020260:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.020294:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120929.020338:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789120929.020342:0:9342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789120929.020403:0:9342:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f556 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.020434:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f54f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e992 expref: 9 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.020454:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f556 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e992 expref: 8 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.020462:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946893a10c00) 00010000:00010000:2.0:1789120929.020465:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789120929.020469:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1600, rc 0) 00000100:00100000:2.0:1789120929.020542:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:10794:x1876028947458688:12345-192.168.202.32@tcp:101:chmod.0 Request processed in 428us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120929.020550:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:2.0:1789120929.030808:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120929.030887:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947458944 00000100:00100000:2.0:1789120929.030898:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947458944 00000100:00100000:2.0:1789120929.030964:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:2.0:1789120929.030975:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:10794:x1876028947458944:12345-192.168.202.32@tcp:36:chmod.0 00010000:00010000:2.0:1789120929.031039:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120929.031069:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f556 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e992 expref: 8 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.031106:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946893a10c00) 00010000:00010000:2.0:1789120929.031119:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120929.031145:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.031158:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.031168:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120929.031373:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000003f6de43 reply state 00000000baac6524 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.031398:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.031404:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946893a10a00) 00010000:00010000:2.0:1789120929.031407:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789120929.031410:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789120929.031417:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789120929.031498:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:10794:x1876028947458944:12345-192.168.202.32@tcp:36:chmod.0 Request processed in 525us (704us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789120929.031506:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:1.0:1789120929.068391:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120929.068859:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947459072 00000100:00100000:3.0:1789120929.068873:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947459072 00000100:00100000:3.0:1789120929.069027:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:3.0:1789120929.069038:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:10795:x1876028947459072:12345-192.168.202.32@tcp:101:chown.0 00010000:00010000:3.0:1789120929.069075:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120929.069111:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830f564 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e999 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.069223:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946887083800/0xb74d2367a830f56b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.069240:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887083800/0xb74d2367a830f56b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.069255:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887083800/0xb74d2367a830f56b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120929.069320:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789120929.069324:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120929.069392:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946887083800/0xb74d2367a830f56b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.069425:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830f564 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e999 expref: 11 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.069451:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946887083800/0xb74d2367a830f56b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e999 expref: 10 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.069462:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946893a10a00) 00010000:00010000:3.0:1789120929.069466:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120929.070001:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887083800, rc 0) 00000100:00100000:3.0:1789120929.070136:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:10795:x1876028947459072:12345-192.168.202.32@tcp:101:chown.0 Request processed in 1097us (1768us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120929.070146:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:0.0:1789120929.087713:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120929.087771:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947459200 00000100:00100000:0.0:1789120929.087783:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947459200 00000100:00100000:0.0:1789120929.087873:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:0.0:1789120929.087886:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:10795:x1876028947459200:12345-192.168.202.32@tcp:101:chown.0 00010000:00010000:0.0:1789120929.087926:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120929.087959:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f572 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9a0 expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088059:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f579 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088080:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f579 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088098:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f579 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088112:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f580 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088120:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088128:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088231:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a830f587 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088240:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a830f587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088247:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a830f587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120929.088296:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789120929.088305:0:9342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789120929.088333:0:9342:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a830f587 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088348:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f579 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088355:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f579 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088362:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f579 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088368:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120929.088373:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f579 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088393:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f579 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088409:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946893a10a00) 00010000:00010000:0.0:1789120929.088412:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120929.088419:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f579 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088425:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f579 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088442:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f580 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088449:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f580 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088468:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f580 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088552:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120929.088556:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f580 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088563:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f580 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088572:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff946893a10600) 00010000:00010000:0.0:1789120929.088575:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120929.088578:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f580 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088584:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f580 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088621:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f572 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9a0 expref: 12 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088638:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a830f587 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9a0 expref: 11 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.088647:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff946893a10400) 00010000:00010000:0.0:1789120929.088649:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120929.088653:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23000, rc 0) 00000100:00100000:0.0:1789120929.088741:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:10795:x1876028947459200:12345-192.168.202.32@tcp:101:chown.0 Request processed in 856us (1043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120929.088759:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:2.0:1789120929.097788:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120929.097939:0:6530:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947459328 00000100:00100000:3.0:1789120929.097951:0:6530:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947459328 00000100:00100000:3.0:1789120929.098045:0:6530:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:3.0:1789120929.098059:0:6530:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:10795:x1876028947459328:12345-192.168.202.32@tcp:900:chown.0 00000100:00100000:3.0:1789120929.098183:0:6530:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:10795:x1876028947459328:12345-192.168.202.32@tcp:900:chown.0 Request processed in 126us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120929.098193:0:6530:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:0.0:1789120929.105889:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120929.106057:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947459584 00000100:00100000:2.0:1789120929.106069:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947459584 00000100:00100000:2.0:1789120929.106142:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:2.0:1789120929.106154:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:10795:x1876028947459584:12345-192.168.202.32@tcp:36:chown.0 00010000:00010000:2.0:1789120929.106256:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120929.106291:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23000/0xb74d2367a830f587 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9a0 expref: 11 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.106314:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff946893a10400) 00010000:00010000:2.0:1789120929.106319:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120929.106351:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.106367:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.106390:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120929.114277:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:1.0:1789120929.114400:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114420:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114446:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120929.114452:0:6518:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000084805d8b reply state 00000000b0c650e8 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114453:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120929.114478:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.114481:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114492:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.114501:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff946893a10400) 00010000:00010000:3.0:1789120929.114507:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789120929.114511:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff946893a10600) 00000100:00100000:3.0:1789120929.114515:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789120929.114516:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120929.114522:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114529:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f541 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120929.114535:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789120929.114556:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114563:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114568:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114573:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120929.114575:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114590:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114599:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff946893a10400) 00010000:00010000:1.0:1789120929.114601:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120929.114604:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114610:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f548 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114638:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114645:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114656:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114661:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120929.114664:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1789120929.114669:0:6518:0:(ldlm_lib.c:3520:target_send_reply()) Schedule reply immediately 00010000:00010000:1.0:1789120929.114670:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.114686:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946893a10a00) 00010000:00010000:1.0:1789120929.114688:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789120929.114691:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120929.114700:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:10795:x1876028947459584:12345-192.168.202.32@tcp:36:chown.0 Request processed in 8541us (8820us total) trans 4294967301 rc 0/0 00010000:00010000:1.0:1789120929.114717:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f55d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120929.114721:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00010000:00010000:0.0:1789120929.115146:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.115155:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.115162:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.115167:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120929.115170:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.115177:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.115187:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff946893a10400) 00010000:00010000:0.0:1789120929.115190:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789120929.115193:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120929.115199:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f58e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120929.154001:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120929.154130:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947459712 00000100:00100000:3.0:1789120929.154142:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947459712 00000100:00100000:3.0:1789120929.154233:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:3.0:1789120929.154245:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:10796:x1876028947459712:12345-192.168.202.32@tcp:101:touch.500 00010000:00010000:3.0:1789120929.154279:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120929.154308:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830f595 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9a7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789120929.156589:0:6520:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 2212us 00000100:00100000:1.0:1789120929.170803:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970623232:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120929.170920:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120929.171044:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970623232 00000100:00100000:1.0:1789120929.171052:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970623232 00000100:00100000:1.0:1789120929.171108:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789120929.171118:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970623232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789120929.171163:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120929.171215:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970623232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 97us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120929.171223:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789120929.171276:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970623232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120929.172748:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970623360:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120929.172873:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120929.172958:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970623360 00000100:00100000:0.0:1789120929.172981:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970623360 00000100:00100000:0.0:1789120929.173032:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789120929.173042:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970623360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789120929.173076:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789120929.173129:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970623360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120929.173138:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789120929.173185:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970623360:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789120929.216272:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f59c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216308:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f59c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216325:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f59c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216348:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f5a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216356:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216398:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216591:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f5aa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216601:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216609:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120929.216647:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789120929.216652:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789120929.216718:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f5aa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216953:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f59c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216962:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f59c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216970:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f59c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216977:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120929.216982:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f59c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.216991:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f59c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217015:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946893a10a00) 00010000:00010000:2.0:1789120929.217018:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120929.217024:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f59c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217031:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f59c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217048:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217055:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217061:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217067:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120929.217070:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217077:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217084:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9468a3998100) 00010000:00010000:2.0:1789120929.217087:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120929.217090:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f5a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217097:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f5a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217162:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830f595 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9a7 expref: 8 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217178:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f5aa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9a7 expref: 7 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.217186:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9468a3998200) 00010000:00010000:2.0:1789120929.217188:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789120929.217191:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1600, rc 0) 00000100:00100000:2.0:1789120929.217307:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:10796:x1876028947459712:12345-192.168.202.32@tcp:101:touch.500 Request processed in 63062us (63319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120929.217318:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:1.0:1789120929.223186:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120929.223627:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947459968 00000100:00100000:3.0:1789120929.223790:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947459968 00000100:00100000:3.0:1789120929.223967:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:3.0:1789120929.223980:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:10796:x1876028947459968:12345-192.168.202.32@tcp:101:touch.500 00010000:00010000:3.0:1789120929.224011:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120929.224039:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830f5b1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9ae expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.224196:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830f5b8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.224214:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830f5b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.224226:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830f5b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.224418:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.224444:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.224458:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789120929.224930:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789120929.225096:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f5c6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225107:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225135:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225174:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830f5b8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225181:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830f5b8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225187:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830f5b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225193:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887083600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120929.225197:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830f5b8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225204:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830f5b8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225217:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9468a3998200) 00010000:00010000:3.0:1789120929.225220:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120929.225225:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830f5b8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225230:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830f5b8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120929.225243:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e4008034 reply state 000000006b1ef0c3 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225255:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225268:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6f4d6809 (ffff9468a3b96600) 00010000:00010000:3.0:1789120929.225271:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789120929.225274:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789120929.225314:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830f5b1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9ae expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225330:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9ae expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.225337:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9468a3b96500) 00010000:00010000:3.0:1789120929.225340:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120929.225342:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217de00, rc 0) 00000100:00100000:3.0:1789120929.225439:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:10796:x1876028947459968:12345-192.168.202.32@tcp:101:touch.500 Request processed in 1459us (2265us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789120929.225448:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:3.0:1789120929.236866:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120929.237054:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947460224 00000100:00100000:1.0:1789120929.237067:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947460224 00000100:00100000:1.0:1789120929.237134:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:1.0:1789120929.237144:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:10796:x1876028947460224:12345-192.168.202.32@tcp:36:touch.500 00010000:00010000:1.0:1789120929.237223:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120929.237259:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f5c6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9ae expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.237282:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9468a3b96500) 00010000:00010000:1.0:1789120929.237298:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120929.237398:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.237415:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.237427:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120929.237561:0:6518:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000fe311688 reply state 000000008ccb48d2 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.237576:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.237582:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94678280ab00) 00010000:00010000:1.0:1789120929.237586:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789120929.237588:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120929.237709:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:10796:x1876028947460224:12345-192.168.202.32@tcp:36:touch.500 Request processed in 565us (903us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789120929.237718:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:3.0:1789120929.241548:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120929.241684:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947460352 00000100:00100000:2.0:1789120929.241696:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947460352 00000100:00100000:2.0:1789120929.241783:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:2.0:1789120929.241795:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:10796:x1876028947460352:12345-192.168.202.32@tcp:101:touch.500 00010000:00010000:2.0:1789120929.241869:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120929.241898:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f5db lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9b5 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.241969:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f5db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9b5 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.241986:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f5db lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9b5 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.242033:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94678280ab00) 00010000:00010000:2.0:1789120929.242037:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120929.242042:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0600, rc 0) 00000100:00100000:2.0:1789120929.242121:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:10796:x1876028947460352:12345-192.168.202.32@tcp:101:touch.500 Request processed in 328us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120929.242129:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:2.0:1789120929.247227:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120929.247697:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947460480 00000100:00100000:1.0:1789120929.247712:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947460480 00000100:00100000:1.0:1789120929.247918:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:1.0:1789120929.247930:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2408:x1876028947460480:12345-192.168.202.32@tcp:8:touch.500 00010000:00080000:1.0:1789120929.247979:0:8433:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:1.0:1789120929.248025:0:8433:0:(genops.c:1385:class_connect()) connect: client 3dde8702-0a22-4cb8-87f3-66b167299fdd, cookie 0xb74d2367a830f5e2 00002000:00100000:1.0:1789120929.248041:0:8433:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3dde8702-0a22-4cb8-87f3-66b167299fdd/ffff946783de8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789120929.248065:0:8433:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789120929.248201:0:8433:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789120929.248243:0:8433:0:(import.c:65:import_set_state_nolock()) ffff946783dea000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120929.248471:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2408:x1876028947460480:12345-192.168.202.32@tcp:8:touch.500 Request processed in 540us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120929.248480:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:3.0:1789120929.250070:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120929.250445:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947460608 00000100:00100000:1.0:1789120929.250521:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947460608 00000100:00100000:1.0:1789120929.250657:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:1.0:1789120929.250670:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:0:x1876028947460608:12345-192.168.202.32@tcp:2:touch.500 00000100:00080000:2.0:1789120929.251029:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1789120929.272001:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00100000:1.0:1789120929.272016:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000100:00100000:2.0:1789120929.272389:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:0:x1876028947460608:12345-192.168.202.32@tcp:2:touch.500 Request processed in 21699us (22307us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789120929.272407:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:3.0:1789120929.277695:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120929.283674:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947460864 00000100:00100000:1.0:1789120929.283705:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947460864 00000100:00100000:2.0:1789120929.284906:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:2.0:1789120929.284922:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:10796:x1876028947460864:12345-192.168.202.32@tcp:35:touch.500 00000100:00100000:2.0:1789120929.285653:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:10796:x1876028947460864:12345-192.168.202.32@tcp:35:touch.500 Request processed in 729us (7968us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789120929.285664:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:1.0:1789120929.315183:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120929.315269:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947460992 00000100:00100000:3.0:1789120929.315343:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947460992 00000100:00100000:3.0:1789120929.315571:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:3.0:1789120929.315585:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:10798:x1876028947460992:12345-192.168.202.32@tcp:101:rm.0 00010000:00010000:3.0:1789120929.315622:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120929.315653:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f5e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9bc expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.315786:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f5f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.315804:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.315865:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120929.315923:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789120929.315928:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120929.315975:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.316008:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f5e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9bc expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.316033:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9bc expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.316044:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9468a3998200) 00010000:00010000:3.0:1789120929.316047:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120929.316051:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217de00, rc 0) 00000100:00100000:3.0:1789120929.316142:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:10798:x1876028947460992:12345-192.168.202.32@tcp:101:rm.0 Request processed in 559us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120929.316150:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:2.0:1789120929.343068:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120929.349958:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947461248 00000100:00100000:0.0:1789120929.349978:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947461248 00000100:00100000:1.0:1789120929.358813:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:1.0:1789120929.358853:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:10798:x1876028947461248:12345-192.168.202.32@tcp:101:rm.0 00010000:00010000:1.0:1789120929.358882:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120929.358923:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f5f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9c3 expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120929.359081:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789120929.359506:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f5f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9c3 expref: 16 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.359533:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946893a10a00) 00010000:00010000:1.0:1789120929.359536:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120929.359542:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f5f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9c3 expref: 16 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.359570:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2c00, rc 0) 00000100:00100000:1.0:1789120929.359681:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:10798:x1876028947461248:12345-192.168.202.32@tcp:101:rm.0 Request processed in 832us (16629us total) trans 4294967305 rc 301/301 00000100:00100000:1.0:1789120929.359691:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:0.0:1789120929.370295:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120929.371317:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947461376 00000100:00100000:2.0:1789120929.371331:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947461376 00000100:00100000:2.0:1789120929.371440:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:2.0:1789120929.371463:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:10798:x1876028947461376:12345-192.168.202.32@tcp:37:rm.0 00000100:00100000:2.0:1789120929.378211:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:10798:x1876028947461376:12345-192.168.202.32@tcp:37:rm.0 Request processed in 6642us (7823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120929.378230:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789120929.392788:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120929.392945:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947461632 00000100:00100000:3.0:1789120929.392959:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947461632 00000100:00100000:2.0:1789120929.393276:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:2.0:1789120929.393290:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:10798:x1876028947461632:12345-192.168.202.32@tcp:35:rm.0 00000100:00100000:2.0:1789120929.394591:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913ff050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:10798:x1876028947461632:12345-192.168.202.32@tcp:35:rm.0 Request processed in 1293us (1808us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789120929.394605:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:0.0:1789120929.405195:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120929.405484:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947461888 00000100:00100000:1.0:1789120929.405507:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947461888 00000100:00100000:1.0:1789120929.405595:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:1.0:1789120929.405607:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:10798:x1876028947461888:12345-192.168.202.32@tcp:101:rm.0 00010000:00010000:1.0:1789120929.405642:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120929.405669:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f605 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9ca expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.406075:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f60c lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.406095:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f60c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.406110:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f60c lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120929.406125:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789120929.407492:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f605 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9ca expref: 19 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.407885:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f60c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9ca expref: 18 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.407921:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9468a3998200) 00010000:00010000:1.0:1789120929.407925:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789120929.407930:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2600, rc 0) 00000100:00100000:1.0:1789120929.408092:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:10798:x1876028947461888:12345-192.168.202.32@tcp:101:rm.0 Request processed in 2484us (2910us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789120929.408102:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:1.0:1789120929.419314:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120929.419415:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947462016 00000100:00100000:3.0:1789120929.419428:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947462016 00000100:00100000:3.0:1789120929.419512:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:3.0:1789120929.419669:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:10798:x1876028947462016:12345-192.168.202.32@tcp:41:rm.0 00000004:00000024:3.0:1789120929.419752:0:6519:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:3.0:1789120929.419893:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:10798:x1876028947462016:12345-192.168.202.32@tcp:41:rm.0 Request processed in 370us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120929.419903:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:0.0:1789120929.423890:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120929.424011:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947462144 00000100:00100000:2.0:1789120929.424024:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947462144 00000100:00100000:2.0:1789120929.424099:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:2.0:1789120929.424111:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:10798:x1876028947462144:12345-192.168.202.32@tcp:101:rm.0 00010000:00010000:2.0:1789120929.424141:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120929.424170:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f61a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9d1 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424255:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f621 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424275:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f621 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424303:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f621 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424315:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f628 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424323:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424330:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424467:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f62f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424477:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424486:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120929.424540:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789120929.424545:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789120929.424569:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424583:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f62f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424593:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f621 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424600:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f621 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424607:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f621 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424614:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120929.424619:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f621 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424627:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f621 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424648:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9468a3998200) 00010000:00010000:2.0:1789120929.424651:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120929.424658:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f621 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424665:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f621 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424683:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f628 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424689:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f628 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424695:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424701:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120929.424704:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f628 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424710:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f628 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424718:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6f4d6809 (ffff9468a3b96600) 00010000:00010000:2.0:1789120929.424719:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120929.424722:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f628 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424728:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1800/0xb74d2367a830f628 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424772:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f61a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9d1 expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424788:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f62f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9d1 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.424795:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94678280ab00) 00010000:00010000:2.0:1789120929.424797:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120929.424801:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0e00, rc 0) 00000100:00100000:2.0:1789120929.424915:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:10798:x1876028947462144:12345-192.168.202.32@tcp:101:rm.0 Request processed in 805us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120929.424924:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:0.0:1789120929.439678:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120929.439862:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947462400 00000100:00100000:1.0:1789120929.439876:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947462400 00000100:00100000:1.0:1789120929.439955:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:1.0:1789120929.439967:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:10798:x1876028947462400:12345-192.168.202.32@tcp:36:rm.0 00010000:00010000:1.0:1789120929.440043:0:11088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789120929.440081:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0e00/0xb74d2367a830f62f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9d1 expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440111:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f5db lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9b5 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440125:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94678280ab00) 00010000:00010000:1.0:1789120929.440138:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f5f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9bc expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440147:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9468a3998200) 00010000:00010000:1.0:1789120929.440151:0:11088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120929.440182:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f636 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440216:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440228:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440243:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440250:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440257:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440390:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f644 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440398:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f644 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440405:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f644 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789120929.440766:0:11088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1789120929.440778:0:11088:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379629956558ns, next at 380629952544ns, rc = 0 00010000:00010000:1.0:1789120929.440905:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a830f64b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440915:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a830f64b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440935:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a830f64b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440944:0:11088:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a830f64b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440951:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a830f64b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440958:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a830f64b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.440980:0:11088:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120929.441002:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f644 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.441008:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f644 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.442490:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f644 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.442508:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120929.442513:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f644 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.442645:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120929.442653:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a830f64b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.442660:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789120929.442664:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a830f64b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.442674:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a830f64b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.442692:0:8450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94678280ab00) 00010000:00010000:3.0:1789120929.442695:0:8450:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789120929.442701:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a830f64b lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.442707:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a830f64b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.442725:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120929.442727:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120929.442729:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120929.443183:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f644 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.443196:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94678280ab00) 00010000:00010000:1.0:1789120929.443198:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789120929.443219:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f644 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.443226:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f644 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.443252:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f636 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.443260:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f636 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.443266:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f636 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.443271:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120929.443274:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f636 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.444010:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f636 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.444026:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9468a3998200) 00010000:00010000:1.0:1789120929.444029:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120929.444034:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f636 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.444041:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f636 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120929.444056:0:11088:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003e8cc76f reply state 000000008edd35f6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.444090:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120929.444100:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6f4d6809 (ffff9468a3b96600) 00010000:00010000:1.0:1789120929.444103:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789120929.444108:0:11088:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120929.444250:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:10798:x1876028947462400:12345-192.168.202.32@tcp:36:rm.0 Request processed in 4278us (4581us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789120929.444262:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:1.0:1789120929.453818:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120929.453938:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947462656 00000100:00100000:2.0:1789120929.453951:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947462656 00000100:00100000:2.0:1789120929.454031:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:2.0:1789120929.454044:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:10798:x1876028947462656:12345-192.168.202.32@tcp:35:rm.0 00000100:00100000:2.0:1789120929.454348:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:10798:x1876028947462656:12345-192.168.202.32@tcp:35:rm.0 Request processed in 306us (544us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789120929.454358:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:0.0:1789120929.458432:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120929.459091:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947462912 00000100:00100000:3.0:1789120929.459124:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947462912 00000100:00100000:3.0:1789120929.459199:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:3.0:1789120929.459210:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:10798:x1876028947462912:12345-192.168.202.32@tcp:36:rm.0 00010000:00010000:3.0:1789120929.459285:0:6519:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789120929.459320:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f60c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9ca expref: 19 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.459343:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a830f5aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9a7 expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.459355:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9468a3998200) 00010000:00010000:3.0:1789120929.459386:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887083800/0xb74d2367a830f56b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e999 expref: 17 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.459397:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946893a10a00) 00010000:00010000:3.0:1789120929.459403:0:6519:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120929.459434:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f652 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.459449:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f652 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.459742:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f652 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.459769:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.459777:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120929.459798:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.465575:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f660 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.465608:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.465626:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120929.466097:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789120929.466119:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f660 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466126:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f660 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466135:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f660 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466142:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120929.466147:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f660 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466155:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f660 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466171:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9468a3998100) 00010000:00010000:2.0:1789120929.466175:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789120929.466180:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f660 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466187:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f660 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466219:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f652 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466227:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f652 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466232:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f652 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466247:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217c000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120929.466251:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f652 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466258:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f652 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466268:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468a3b96700) 00010000:00010000:2.0:1789120929.466271:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120929.466275:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f652 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466280:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830f652 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120929.466303:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000003ea34cc9 reply state 00000000f25b65ba transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466317:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120929.466325:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9468a3b96900) 00010000:00010000:2.0:1789120929.466328:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789120929.466332:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120929.466473:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:10798:x1876028947462912:12345-192.168.202.32@tcp:36:rm.0 Request processed in 7258us (8050us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789120929.466485:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00010000:00010000:3.0:1789120929.491219:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120930.516404:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120931.218082:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120931.218115:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970623488:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120931.218215:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120931.218781:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970623488 00000100:00100000:2.0:1789120931.218793:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970623488 00000100:00080000:3.0:1789120931.218892:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120931.218937:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789120931.218950:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970623488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789120931.218993:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120931.219070:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970623488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120931.219079:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00010000:00080000:0.0:1789120931.219374:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b261c0 x1876028970623488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120931.219399:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970623488:0@lo:13:osp-pre-0-1.0 00000004:00080000:2.0:1789120931.220082:0:8913:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381409260021ns, next at 382409257126ns, rc = 0 00000100:00100000:2.0:1789120931.220107:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120931.220121:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970623616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120931.220167:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120931.220204:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970623616 00000100:00100000:2.0:1789120931.220209:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970623616 00000100:00100000:2.0:1789120931.220249:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789120931.220461:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970623616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120931.220481:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120931.220587:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970623616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 330us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120931.220595:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:2.0:1789120931.220616:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789120931.220637:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b261c0 x1876028970623616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120931.220653:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970623616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120931.221639:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970623744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120931.221693:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120931.221722:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970623744 00000100:00100000:2.0:1789120931.221728:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970623744 00000100:00100000:2.0:1789120931.221786:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1789120931.221796:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970623744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120931.221865:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120931.221915:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970623744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120931.221933:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:2.0:1789120931.221952:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789120931.221977:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d1e1c0 x1876028970623744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120931.221993:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970623744:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120931.227336:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120931.227380:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970624256:0@lo:400:kworker.0 00000100:00100000:0.0:1789120931.227444:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970624384:0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.227485:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120931.227493:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120931.227569:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970624384 00000100:00100000:1.0:1789120931.227579:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970624384 00000100:00100000:1.0:1789120931.227659:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789120931.227672:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970624384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120931.228527:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970624128:0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.230453:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970623872:0@lo:400:kworker.0 00000100:00100000:0.0:1789120931.230453:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970624896:0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.230736:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120931.230785:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970624768:0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.230855:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120931.230903:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970624256 00000100:00100000:2.0:1789120931.230911:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970624256 00000100:00100000:2.0:1789120931.230974:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970624768 00000100:00100000:2.0:1789120931.230977:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970624768 00000100:00100000:2.0:1789120931.231158:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789120931.231169:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970624256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.231239:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970624256:12345-0@lo:400:kworker.0 Request processed in 72us (3755us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120931.231248:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789120931.231340:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789120931.231349:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970624768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.231401:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848943c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970624768:12345-0@lo:400:kworker.0 Request processed in 54us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120931.231407:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1789120931.231439:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120931.231477:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970624768:0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.231491:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f6f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970624256:0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.231885:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970623872 00000100:00100000:2.0:1789120931.231890:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970623872 00000100:00100000:2.0:1789120931.231919:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1789120931.231923:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970623872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.231955:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970623872:12345-0@lo:400:kworker.0 Request processed in 32us (1221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120931.231960:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1789120931.231999:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970623872:0@lo:400:kworker.0 00000100:00100000:0.0:1789120931.232080:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120931.232144:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970624896 00000100:00100000:2.0:1789120931.232149:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970624896 00000100:00100000:2.0:1789120931.232192:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789120931.232200:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970624896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.232246:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970624896:12345-0@lo:400:kworker.0 Request processed in 48us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120931.232252:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00010000:00080000:2.0:1789120931.232353:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467848912c0 x1876028970624896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120931.232379:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848912c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970624896:0@lo:400:kworker.0 00000100:00080000:2.0:1789120931.232406:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789120931.232989:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970624000:0@lo:400:kworker.0 00000100:00100000:1.0:1789120931.233040:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120931.233076:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970624512:0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.233100:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970624000 00000100:00100000:1.0:1789120931.233106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120931.233107:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970624000 00000100:00100000:1.0:1789120931.233133:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970625024:0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.233148:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970624512 00000100:00100000:2.0:1789120931.233152:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970624512 00000100:00100000:1.0:1789120931.233168:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120931.233187:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789120931.233197:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970624000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120931.233215:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970625024 00000100:00100000:1.0:1789120931.233220:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970625024 00000100:00100000:2.0:1789120931.233327:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970624000:12345-0@lo:400:kworker.0 Request processed in 58us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120931.233761:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789120931.233778:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789120931.233783:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970624512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.233897:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970624512:12345-0@lo:400:kworker.0 Request processed in 114us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120931.233902:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:2.0:1789120931.233916:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120931.233919:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120931.234884:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789120931.234908:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970625024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120931.234973:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970625024:12345-0@lo:400:kworker.0 Request processed in 76us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120931.234995:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789120931.235089:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970624000:0@lo:400:kworker.0 00000100:00100000:1.0:1789120931.235104:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970624512:0@lo:400:kworker.0 00010000:00080000:1.0:1789120931.235119:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784892d00 x1876028970625024/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120931.235131:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970625024:0@lo:400:kworker.0 00000100:00100000:1.0:1789120931.235201:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970624384:12345-0@lo:400:kworker.0 Request processed in 7531us (7707us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120931.235211:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789120931.235247:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f6e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970624384:0@lo:400:kworker.0 00000100:00100000:3.0:1789120931.237068:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120931.237127:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970624128 00000100:00100000:2.0:1789120931.237135:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970624128 00000100:00100000:2.0:1789120931.237205:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789120931.237215:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970624128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.237310:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970624128:12345-0@lo:400:kworker.0 Request processed in 96us (3834us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120931.237317:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789120931.237372:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970624128:0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.237406:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970624640:0@lo:400:kworker.0 00000100:00100000:2.0:1789120931.237453:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120931.237533:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970624640 00000100:00100000:3.0:1789120931.237538:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970624640 00000100:00080000:2.0:1789120931.237589:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789120931.237592:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789120931.237601:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970624640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120931.237647:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970624640:12345-0@lo:400:kworker.0 Request processed in 47us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120931.237653:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00010000:00080000:2.0:1789120931.237850:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784892940 x1876028970624640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120931.237862:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970624640:0@lo:400:kworker.0 00000100:00100000:3.0:1789120931.287519:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120931.287622:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120931.287666:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120931.287698:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120931.287730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120931.287767:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947463424 00000100:00100000:3.0:1789120931.287779:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947463424 00000100:00100000:3.0:1789120931.287894:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:3.0:1789120931.287906:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947463424:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120931.288001:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947463424:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 97us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120931.288041:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:3.0:1789120931.288074:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947463296 00000100:00100000:3.0:1789120931.288079:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947463296 00000100:00100000:3.0:1789120931.288109:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947463168 00000100:00100000:3.0:1789120931.288112:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947463168 00000100:00100000:3.0:1789120931.288133:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947463680 00000100:00100000:3.0:1789120931.288136:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947463680 00000100:00100000:3.0:1789120931.288153:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 251 00000100:00100000:3.0:1789120931.288160:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947463296:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120931.288193:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947463296:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 33us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120931.288200:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 251 00000100:00100000:3.0:1789120931.288213:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 252 00000100:00100000:3.0:1789120931.288219:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:2409:x1876028947463168:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120931.288251:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:2409:x1876028947463168:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 32us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120931.288258:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 252 00000100:00100000:3.0:1789120931.288271:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 253 00000100:00100000:3.0:1789120931.288278:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf662580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947463680:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120931.288303:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf662580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947463680:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 26us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120931.288310:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 253 00000100:00100000:2.0:1789120931.288982:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947463040 00000100:00100000:2.0:1789120931.288990:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947463040 00000100:00100000:2.0:1789120931.289178:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 407 00000100:00100000:2.0:1789120931.289190:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947463040:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120931.289249:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947463040:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 62us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120931.289257:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 407 00000100:00080000:2.0:1789120931.289447:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120931.289453:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789120931.289457:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120931.292995:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120931.293250:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947463552 00000100:00100000:0.0:1789120931.293262:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947463552 00000100:00100000:0.0:1789120931.293344:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 254 00000100:00100000:0.0:1789120931.293366:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947463552:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120931.293462:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947463552:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 107us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120931.293470:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 254 00000100:00080000:2.0:1789120931.293574:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789120931.540768:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120931.731720:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789120931.731744:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970625152:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789120931.731864:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120931.731992:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970625152 00000100:00100000:0.0:1789120931.732000:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970625152 00000100:00100000:0.0:1789120931.732055:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789120931.732064:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970625152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120931.732086:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120931.732136:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970625152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120931.732144:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1789120931.732233:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783ebcb40 x1876028970625152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120947 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120931.732251:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970625152:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789120932.562512:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120933.586802:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789120934.224847:0:14395:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1789120934.291731:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120934.291762:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970625280:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120934.291882:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120934.291967:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970625280 00000100:00100000:1.0:1789120934.291977:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970625280 00000100:00100000:1.0:1789120934.292039:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789120934.292050:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970625280:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789120934.292095:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120934.292147:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970625280:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120934.292168:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789120934.292230:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970625280:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120934.296927:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120934.302959:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970625408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789120934.303071:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120934.310730:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970625408 00000100:00100000:2.0:1789120934.310749:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970625408 00000100:00100000:2.0:1789120934.310898:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789120934.310910:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970625408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789120934.310963:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789120934.311083:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970625408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 176us (8013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120934.311092:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789120934.311228:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970625408:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789120934.610111:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789120934.808399:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:0.0:1789120934.808536:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:0.0:1789120934.808548:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00010000:00010000:3.0:1789120934.808592:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808609:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808631:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808640:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887082600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120934.808646:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808656:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808678:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6f4d6809 (ffff9468a3b96600) 00010000:00010000:3.0:1789120934.808682:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120934.808688:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808696:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830f5bf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808716:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808730:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808737:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808742:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120934.808745:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808752:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808761:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff94678280ab00) 00010000:00010000:3.0:1789120934.808763:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120934.808777:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808784:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f5d4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808807:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808813:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808837:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808844:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120934.808854:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808861:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808869:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x6f4d6809 (ffff9468a3b96600) 00010000:00010000:3.0:1789120934.808872:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120934.808875:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808880:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f63d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x6f4d6809 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808898:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808904:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808910:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808916:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217de00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120934.808919:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808925:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808933:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9468a3b96900) 00010000:00010000:3.0:1789120934.808935:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120934.808944:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.808951:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830f659 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120934.810305:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120934.810340:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970625536:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789120934.810432:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120934.810962:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970625536 00000100:00100000:1.0:1789120934.810973:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970625536 00000100:00100000:1.0:1789120934.811057:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789120934.811070:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970625536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789120934.811110:0:9116:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1789120934.811158:0:9116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x6aa3d1a0, atime: 0x6aa3d1a0, ctime: 0x6aa3d1a0, blocks: 0x0 00010000:00010000:1.0:1789120934.811168:0:9116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a830f667 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120934.811189:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=384s v=(0 0) 00010000:00010000:1.0:1789120934.811194:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00000100:00080000:3.0:1789120934.811816:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789120934.811949:0:9116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a830f667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120934.811977:0:9116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a830f667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120934.811990:0:9116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a830f667 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120934.811997:0:9116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a830f667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120934.812083:0:9116:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789120934.812387:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970625536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1317us (1951us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789120934.812400:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000004:00080000:1.0:1789120934.813418:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946783ebc780/2, rc 0, transno 4294967301 00000100:00100000:1.0:1789120934.813431:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970625536:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789120934.815211:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120934.815344:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a830f667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.815362:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789120934.815368:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a830f667 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.815381:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a830f667 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.815418:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a830f667 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.815426:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb4be2aa/0xb74d2367a830f667 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120934.815453:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120934.815455:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120934.815457:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120935.634938:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789120935.642094:0:14443:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff0b0ff560 20000000:00000080:2.0:1789120935.642112:0:14443:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff946783d4b800 uarg=0000000000000000 20000000:01000000:2.0:1789120935.642158:0:14443:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789120935.642164:0:14443:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1789120935.642169:0:14443:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789120935.643268:0:14444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 20000000:02000000:2.0:1789120935.644753:0:14443:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789120935.653534:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 224 off10720 00000040:00080000:2.0:1789120935.653573:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 128 off10848 00000040:00080000:2.0:1789120935.653589:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off11072 10000000:01000000:2.0:1789120935.653604:0:14443:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789120935.653624:0:14443:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.653645:0:14443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a2800/0xb74d2367a830f4f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e984 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.653655:0:14443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9467838d1200/0xb74d2367a830f502 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f4fb expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.653662:0:14443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f510 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f509 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.653669:0:14443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468c217d600/0xb74d2367a830f51e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f517 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.653676:0:14443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f52c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f525 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.653683:0:14443:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946783e23600/0xb74d2367a830f533 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e98b expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.653707:0:14443:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.653747:0:14443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946783e23600/0xb74d2367a830f533 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e98b expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.653762:0:14443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946783e23600/0xb74d2367a830f533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e98b expref: 12 pid: 6513 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120935.653776:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848970c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970625664:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120935.653960:0:14443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f52c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f525 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.653969:0:14443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f52c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f525 expref: 23 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120935.653979:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970625792:0@lo:104: 00000100:00100000:2.0:1789120935.654023:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120935.654078:0:14443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468c217d600/0xb74d2367a830f51e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f517 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120935.654084:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970625792 00010000:00010000:2.0:1789120935.654087:0:14443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468c217d600/0xb74d2367a830f51e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f517 expref: 23 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120935.654100:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970625920:0@lo:104: 00000100:00100000:3.0:1789120935.654101:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970625792 00000100:00100000:2.0:1789120935.654132:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120935.660471:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970625920 00000100:00100000:3.0:1789120935.660486:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970625920 00000100:00100000:3.0:1789120935.660913:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789120935.660926:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784896940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:14443:x1876028970625792:12345-0@lo:104: 00010000:00010000:3.0:1789120935.660950:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120935.661053:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120935.661060:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784896940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+4:14443:x1876028970625792:12345-0@lo:104: Request processed in 138us (7037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120935.661068:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1789120935.661086:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789120935.661092:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00010000:00010000:1.0:1789120935.661095:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120935.661102:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:14443:x1876028970625920:12345-0@lo:104: 00010000:00010000:1.0:1789120935.661109:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc130ac20) 00010000:00010000:3.0:1789120935.661115:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120935.661116:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120935.661138:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789120935.661148:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120935.661155:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789120935.661173:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789120935.661180:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848952c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:14443:x1876028970625920:12345-0@lo:104: Request processed in 81us (7048us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120935.661186:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1789120935.661210:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120935.661212:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120935.661216:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120935.661221:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789120935.661246:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120935.661276:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c217d400/0xb74d2367a830f525 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f52c expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120935.661293:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120935.661295:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120935.661296:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120935.661335:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970626048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789120935.661406:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120935.661486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120935.661577:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970626048 00000100:00100000:1.0:1789120935.661582:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970626048 00010000:00010000:1.0:1789120935.661603:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f52c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f525 expref: 24 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120935.661634:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947463808 00000100:00100000:1.0:1789120935.661637:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947463808 00010000:00010000:1.0:1789120935.661651:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946783e23600/0xb74d2367a830f533 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e98b expref: 13 pid: 6513 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120935.661670:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789120935.661676:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970626048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789120935.661687:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120935.661692:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f52c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f525 expref: 24 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120935.661716:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f52c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f525 expref: 24 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120935.661735:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120935.661777:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970626048:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120935.661784:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789120935.661798:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:1.0:1789120935.661803:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947463808:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120935.661811:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120935.661814:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946783e23600/0xb74d2367a830f533 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e98b expref: 13 pid: 6513 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120935.661844:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946783e23600/0xb74d2367a830f533 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e98b expref: 13 pid: 6513 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120935.661855:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120935.662103:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835e9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947463808:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 296us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120935.662112:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00010000:00010000:3.0:1789120935.662168:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d200 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789120935.662173:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120935.662196:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120935.662203:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120935.662210:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:0.0:1789120935.663419:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970626048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789120935.663843:0:14443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f509 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.663874:0:14443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f510 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f509 expref: 23 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120935.663887:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970626176:0@lo:104: 00000100:00100000:2.0:1789120935.664097:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120935.664472:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970626176 00000100:00100000:0.0:1789120935.664478:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970626176 00000100:00100000:0.0:1789120935.664523:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789120935.664532:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:14443:x1876028970626176:12345-0@lo:104: 00010000:00010000:0.0:1789120935.664552:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.664600:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789120935.664606:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848961c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:14443:x1876028970626176:12345-0@lo:104: Request processed in 75us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120935.664612:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1789120935.664669:0:14443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9467838d1200/0xb74d2367a830f502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a830f4fb expref: 23 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.664679:0:14443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9467838d1200/0xb74d2367a830f502 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a830f4fb expref: 23 pid: 6510 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120935.664688:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970626304:0@lo:104: 00000100:00100000:2.0:1789120935.664714:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789120935.664749:0:14443:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a2800/0xb74d2367a830f4f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e984 expref: 12 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.664761:0:14443:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468b99a2800/0xb74d2367a830f4f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e984 expref: 12 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120935.664770:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970626432:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120935.665180:0:6502:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970626304 00000100:00100000:0.0:1789120935.665185:0:6502:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970626304 00000100:00100000:0.0:1789120935.665212:0:6502:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789120935.665218:0:6502:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784895e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:14443:x1876028970626304:12345-0@lo:104: 00010000:00010000:0.0:1789120935.665227:0:6502:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.665272:0:6502:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789120935.665277:0:6502:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784895e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:03a1864a-46e4-4762-8a00-3ced97b06903+3:14443:x1876028970626304:12345-0@lo:104: Request processed in 60us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120935.665284:0:6502:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789120935.665425:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0e480 going to sleep for 11 seconds 00010000:00010000:2.0:1789120935.665450:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e23600/0xb74d2367a830f533 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e98b expref: 12 pid: 6513 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120935.665462:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848970c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970625664:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120935.665473:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0c00/0xb74d2367a830f52c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f525 expref: 23 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120935.665494:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970625792:0@lo:104: 00000100:00100000:2.0:1789120935.665505:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970625920:0@lo:104: 00000100:00100000:2.0:1789120935.665512:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970626176:0@lo:104: 00000100:00100000:2.0:1789120935.665518:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970626304:0@lo:104: 00010000:00010000:2.0:1789120935.665567:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789120935.665573:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.665581:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789120935.665585:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.665594:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789120935.665601:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120935.665607:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789120935.666474:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120935.666481:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120935.666491:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2200 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789120935.666495:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120935.666502:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789120935.666509:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120935.666513:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789120935.667243:0:6506:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.667253:0:6506:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120935.667290:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.667298:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9467838d0400/0xb74d2367a830f509 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f510 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.667342:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120935.667344:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120935.667346:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120935.667379:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.667385:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789120935.667392:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.667399:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a830f517 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f51e expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.667408:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120935.667410:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120935.667411:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120935.667467:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970626560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120935.667536:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120935.667593:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120935.667599:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970626688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120935.667620:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120935.667651:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970626560 00000100:00100000:0.0:1789120935.667657:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970626560 00010000:00010000:0.0:1789120935.667689:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f510 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f509 expref: 23 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120935.667726:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970626688 00000100:00100000:0.0:1789120935.667729:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970626688 00010000:00010000:0.0:1789120935.667742:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468c217d600/0xb74d2367a830f51e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f517 expref: 24 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120935.667761:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789120935.667769:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784892580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970626560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120935.667782:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120935.667787:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f510 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f509 expref: 24 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.667797:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f510 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f509 expref: 24 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.667814:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217cc00/0xb74d2367a830f510 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f509 expref: 24 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.667853:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120935.667886:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784892580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+23:3644:x1876028970626560:12345-0@lo:103:ldlm_bl.0 Request processed in 117us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120935.667904:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789120935.667921:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789120935.667928:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+22:3644:x1876028970626688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120935.667935:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120935.667939:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468c217d600/0xb74d2367a830f51e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f517 expref: 22 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.667949:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468c217d600/0xb74d2367a830f51e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f517 expref: 22 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.667967:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217d600/0xb74d2367a830f51e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f517 expref: 22 pid: 6512 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.667975:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120935.668000:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+21:3644:x1876028970626688:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120935.668007:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789120935.668045:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970626688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120935.668053:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970626560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789120935.675778:0:8450:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120935.675796:0:8450:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789120935.675846:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120935.675854:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f4fb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a830f502 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120935.675889:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120935.675891:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120935.675894:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120935.675967:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120935.676109:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970626816:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789120935.676160:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120935.676247:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14443:1876028970626432:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120935.676286:0:14443:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120935.676460:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947463936 00000100:00100000:0.0:1789120935.676468:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947463936 00010000:00010000:0.0:1789120935.676498:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a2800/0xb74d2367a830f4f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e984 expref: 12 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120935.676530:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970626816 00000100:00100000:0.0:1789120935.676533:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970626816 00010000:00010000:0.0:1789120935.676546:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9467838d1200/0xb74d2367a830f502 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f4fb expref: 21 pid: 6510 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120935.678013:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:0.0:1789120935.678032:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75b5d71e-0e31-479d-b240-b6a98d05b974+12:2412:x1876028947463936:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120935.678050:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120935.678058:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a2800/0xb74d2367a830f4f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e984 expref: 12 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678071:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a2800/0xb74d2367a830f4f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e984 expref: 12 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678104:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a2800/0xb74d2367a830f4f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e984 expref: 12 pid: 6512 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678126:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120935.678187:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75b5d71e-0e31-479d-b240-b6a98d05b974+11:2412:x1876028947463936:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 162us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120935.678195:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:0.0:1789120935.678217:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789120935.678225:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784895a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+21:3646:x1876028970626816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789120935.678233:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120935.678238:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9467838d1200/0xb74d2367a830f502 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a830f4fb expref: 21 pid: 6510 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678248:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9467838d1200/0xb74d2367a830f502 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a830f4fb expref: 21 pid: 6510 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678260:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1200/0xb74d2367a830f502 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a830f4fb expref: 21 pid: 6510 timeout: 535 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678271:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678280:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678297:0:10341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678304:0:10341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678328:0:10341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678335:0:10341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678352:0:10341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789120935.678356:0:10341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678366:0:10341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678382:0:10341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120935.678394:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120935.678450:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784895a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+20:3646:x1876028970626816:12345-0@lo:103:ldlm_bl.0 Request processed in 225us (2288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120935.678457:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00010000:2.0:1789120935.681107:0:14443:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.681127:0:14443:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120935.681135:0:14443:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0000/0xb74d2367a830f66e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14443 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120935.682589:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970626816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789120936.337972:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120936.337996:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970626944:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.338078:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120936.338148:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970626944 00000100:00100000:0.0:1789120936.338156:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970626944 00000100:00100000:0.0:1789120936.338201:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1789120936.338210:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:3646:x1876028970626944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.338271:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:3646:x1876028970626944:12345-0@lo:400:kworker.0 Request processed in 62us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.338279:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:0.0:1789120936.338338:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970626944:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.338382:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970627072:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.338422:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120936.338710:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970627072 00000100:00100000:0.0:1789120936.338715:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970627072 00000100:00100000:0.0:1789120936.338746:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789120936.338762:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970627072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.338802:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970627072:12345-0@lo:400:kworker.0 Request processed in 50us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.338808:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1789120936.338860:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970627072:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.338891:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970627200:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.338918:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120936.338946:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970627200 00000100:00100000:0.0:1789120936.339005:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970627200 00000100:00100000:0.0:1789120936.339095:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789120936.339103:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970627200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.339141:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970627200:12345-0@lo:400:kworker.0 Request processed in 40us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.339148:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789120936.339176:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970627200:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.339217:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970627328:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.339245:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120936.339285:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120936.339291:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970627456:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.339326:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120936.339364:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970627584:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.339387:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120936.339603:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970627328 00000100:00100000:0.0:1789120936.339608:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970627328 00000100:00100000:0.0:1789120936.339669:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970627584 00000100:00100000:0.0:1789120936.339673:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970627584 00000100:00080000:3.0:1789120936.340167:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120936.340191:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120936.340201:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970627840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120936.340238:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120936.340268:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970627840 00000100:00100000:3.0:1789120936.340272:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970627840 00000100:00100000:3.0:1789120936.340305:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789120936.340324:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970627840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120936.340348:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120936.340384:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970627840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.340390:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00080000:3.0:1789120936.340426:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789120936.340448:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783ec8000 x1876028970627840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120936.340474:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970627840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120936.340492:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120936.340499:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970627712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120936.340525:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120936.340545:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970627712 00000100:00100000:3.0:1789120936.340548:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970627712 00000100:00100000:3.0:1789120936.340572:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789120936.340578:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970627712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120936.340602:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120936.340633:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970627712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.340639:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00080000:3.0:1789120936.340655:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120936.340674:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970627712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789120936.342236:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789120936.342253:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970627328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120936.342341:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970627328:12345-0@lo:400:kworker.0 Request processed in 95us (3096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120936.342350:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1789120936.342374:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789120936.342381:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784892940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970627584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120936.343105:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970627456 00000100:00100000:2.0:1789120936.343114:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970627456 00000100:00100000:2.0:1789120936.343166:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789120936.343172:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970627456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.343363:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120936.343376:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970628096:0@lo:400:kworker.0 00000100:00100000:3.0:1789120936.343472:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970627968:0@lo:400:kworker.0 00000100:00100000:2.0:1789120936.343533:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970627456:12345-0@lo:400:kworker.0 Request processed in 361us (4206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.343541:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789120936.344944:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789120936.344971:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970628224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120936.345039:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120936.345101:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970627456:0@lo:400:kworker.0 00000100:00100000:2.0:1789120936.345115:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848903c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970627328:0@lo:400:kworker.0 00000100:00100000:1.0:1789120936.345392:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784892940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970627584:12345-0@lo:400:kworker.0 Request processed in 3009us (6001us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.345919:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120936.346118:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970628352:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.346158:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120936.346197:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970628352 00000100:00100000:0.0:1789120936.346203:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970628352 00000100:00100000:0.0:1789120936.346255:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789120936.346265:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970628352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.346324:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970628352:12345-0@lo:400:kworker.0 Request processed in 60us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.346331:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789120936.346366:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970628352:0@lo:400:kworker.0 00000100:00100000:2.0:1789120936.346582:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970627584:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.346623:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120936.346632:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970628480:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.346671:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120936.346729:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970628608:0@lo:400:kworker.0 00000100:00100000:1.0:1789120936.346867:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1789120936.346892:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970628480 00000100:00100000:1.0:1789120936.346896:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970628480 00000100:00100000:1.0:1789120936.346924:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1789120936.346930:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970628480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120936.347123:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848930c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970628480:12345-0@lo:400:kworker.0 Request processed in 192us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120936.347129:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00010000:00080000:1.0:1789120936.347160:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784890f00 x1876028970628480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120936.347172:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970628480:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.347727:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120936.349425:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120936.349551:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970628096 00000100:00100000:2.0:1789120936.349560:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970628096 00000100:00100000:2.0:1789120936.349615:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970628608 00000100:00100000:2.0:1789120936.349618:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970628608 00000100:00100000:0.0:1789120936.349636:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970627968 00000100:00100000:0.0:1789120936.349640:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970627968 00000100:00100000:2.0:1789120936.349645:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789120936.349653:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970628096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.349669:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789120936.349675:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970627968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120936.349784:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789120936.349793:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970628608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120936.349922:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848912c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970628096:12345-0@lo:400:kworker.0 Request processed in 269us (4002us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.349931:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1789120936.351035:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120936.351043:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120936.351046:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789120936.351056:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120936.351072:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970628224 00000100:00100000:2.0:1789120936.351078:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970628224 00000100:00100000:2.0:1789120936.351119:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789120936.351127:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876028970628224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120936.351148:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120936.351207:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784897480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3644:x1876028970628224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (6168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.351227:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789120936.352445:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970628608:12345-0@lo:400:kworker.0 Request processed in 2648us (4713us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.352457:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789120936.352608:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970627968:12345-0@lo:400:kworker.0 Request processed in 2932us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.352617:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789120936.352665:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970628096:0@lo:400:kworker.0 00010000:00080000:0.0:1789120936.352700:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784891680 x1876028970628608/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120936.352711:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970628608:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.352729:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970628224:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1789120936.353250:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784892d00 x1876028970627968/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120952 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120936.353261:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970627968:0@lo:400:kworker.0 00000100:00100000:0.0:1789120936.402434:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120936.402475:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120936.402504:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120936.402526:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120936.402545:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120936.402563:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120936.402588:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947464448 00000100:00100000:0.0:1789120936.402597:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947464448 00000100:00100000:0.0:1789120936.402654:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 87 00000100:00100000:0.0:1789120936.402664:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947464448:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120936.402740:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947464448:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 77us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.402748:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 87 00000100:00100000:0.0:1789120936.402775:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947464192 00000100:00100000:0.0:1789120936.402778:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947464192 00000100:00100000:0.0:1789120936.402803:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947464704 00000100:00100000:0.0:1789120936.402805:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947464704 00000100:00100000:0.0:1789120936.402817:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947464320 00000100:00100000:0.0:1789120936.402894:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947464320 00000100:00100000:0.0:1789120936.402910:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947464576 00000100:00100000:0.0:1789120936.402912:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947464576 00000100:00100000:0.0:1789120936.402925:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 261 00000100:00100000:0.0:1789120936.402930:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947464192:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120936.402960:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947464192:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.402966:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 261 00000100:00100000:0.0:1789120936.402979:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 262 00000100:00100000:0.0:1789120936.402985:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947464704:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120936.403007:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947464704:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 23us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.403013:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 262 00000100:00100000:0.0:1789120936.403023:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 263 00000100:00100000:0.0:1789120936.403029:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947464320:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120936.403072:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947464320:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 42us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.403086:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 263 00000100:00100000:0.0:1789120936.403098:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 264 00000100:00100000:0.0:1789120936.403104:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947464576:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120936.403129:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947464576:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.403134:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 264 00000100:00080000:0.0:1789120936.403152:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789120936.403155:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120936.403158:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120936.403421:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947464064 00000100:00100000:3.0:1789120936.403426:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947464064 00000100:00100000:3.0:1789120936.403464:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 409 00000100:00100000:3.0:1789120936.403471:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+11:2410:x1876028947464064:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120936.403551:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+11:2410:x1876028947464064:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 80us (1127us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.403558:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 409 00000020:00000080:0.0:1789120936.643446:0:14492:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffb3335980 20000000:00000080:0.0:1789120936.643583:0:14492:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff946783d2e400 uarg=0000000000000000 20000000:01000000:0.0:1789120936.643630:0:14492:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789120936.643638:0:14492:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1789120936.643643:0:14492:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1789120936.648147:0:14493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 16 count 16 20000000:02000000:0.0:1789120936.648360:0:14492:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1789120936.648532:0:14492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11296 00000040:00080000:0.0:1789120936.648563:0:14492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 128 off11424 00000040:00080000:0.0:1789120936.648579:0:14492:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11648 10000000:01000000:0.0:1789120936.648592:0:14492:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789120936.648616:0:14492:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946783e23000/0xb74d2367a830f675 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.648631:0:14492:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e23000/0xb74d2367a830f675 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.648641:0:14492:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946783e23000/0xb74d2367a830f675 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.648662:0:14492:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946783e23000/0xb74d2367a830f675 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.648668:0:14492:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946783e23000/0xb74d2367a830f675 lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.648675:0:14492:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946783e23000/0xb74d2367a830f675 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.648680:0:14492:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789120936.648684:0:14492:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946783e23000/0xb74d2367a830f675 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.648692:0:14492:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946783e23000/0xb74d2367a830f675 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.648705:0:14492:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946783e23000/0xb74d2367a830f675 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.648712:0:14492:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946783e23000/0xb74d2367a830f675 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.648718:0:14492:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e23000/0xb74d2367a830f675 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14492 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120936.660679:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120936.718296:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120936.718424:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947464832 00000100:00100000:3.0:1789120936.718435:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947464832 00000100:00100000:3.0:1789120936.718508:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 410 00000100:00100000:3.0:1789120936.718519:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+11:6186:x1876028947464832:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120936.718536:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120936.718566:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468a2f10200/0xb74d2367a830f67c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9d8 expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.718595:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468a2f10200/0xb74d2367a830f67c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9d8 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.718606:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468a2f10200/0xb74d2367a830f67c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9d8 expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.718615:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f10200, rc 0) 00000100:00100000:3.0:1789120936.718845:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947464832:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 299us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.718854:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 410 10000000:01000000:1.0:1789120936.721919:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789120936.721927:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946782aee800 from 13 10000000:01000000:1.0:1789120936.721933:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789120936.721975:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120936.721986:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120936.721997:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120936.722022:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970628736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120936.722091:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120936.722145:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789120936.722207:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970628736 00000100:00100000:0.0:1789120936.722224:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970628736 00000100:00100000:0.0:1789120936.722277:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1789120936.722286:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+20:6515:x1876028970628736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789120936.722316:0:6510:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120936.722331:0:6510:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e23000/0xb74d2367a830f68a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f683 expref: -99 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.722355:0:6510:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e23000/0xb74d2367a830f68a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f683 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.722366:0:6510:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e23000/0xb74d2367a830f68a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f683 expref: 21 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120936.722375:0:6510:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23000, rc 0) 00000100:00100000:0.0:1789120936.722419:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970628736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.722426:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1789120936.722625:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970628736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120936.722648:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120936.722658:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120936.722717:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970628864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120936.722744:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120936.722769:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789120936.722843:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970628864 00000100:00100000:0.0:1789120936.722847:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970628864 00000100:00100000:0.0:1789120936.722869:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1789120936.722875:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970628864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789120936.722974:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970628864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 98us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.722980:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1789120936.723049:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970628864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120936.723077:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970628992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120936.723114:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120936.723143:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0f840 going to sleep for 11 seconds 00000100:00100000:0.0:1789120936.723188:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970628992 00000100:00100000:0.0:1789120936.723192:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970628992 00000100:00100000:0.0:1789120936.724035:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1789120936.724047:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970628992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789120936.724155:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970628992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120936.724172:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1789120936.724255:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970628992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120936.724470:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14501:1876028970629120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120936.724511:0:14501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120936.727438:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0ecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120936.727664:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970629120 00000100:00100000:1.0:1789120936.727673:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970629120 00000100:00100000:1.0:1789120936.727728:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:1.0:1789120936.727738:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:14501:x1876028970629120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120936.728160:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+21:14501:x1876028970629120:12345-0@lo:502:llog_process_th.0 Request processed in 422us (3648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120936.728168:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:2.0:1789120936.728265:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14501:1876028970629120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120936.728670:0:14501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120936.728680:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.728683:0:14501:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789120936.728689:0:14501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946782aee800 00000020:00000080:2.0:1789120936.728692:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789120936.728800:0:14501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120936.728805:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.728806:0:14501:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789120936.728809:0:14501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120936.728811:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.728990:0:14501:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789120936.728996:0:14501:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946782aee800 00000020:00000080:2.0:1789120936.728998:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789120936.734220:0:14501:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14501:1876028970629248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120936.734328:0:14501:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120936.734373:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970629248 00000100:00100000:2.0:1789120936.734380:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970629248 00000100:00100000:2.0:1789120936.734430:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789120936.734438:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:14501:x1876028970629248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120936.734552:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+21:14501:x1876028970629248:12345-0@lo:502:llog_process_th.0 Request processed in 114us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.734559:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00000100:00100000:2.0:1789120936.734606:0:14501:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120936.734624:0:14501:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14501:1876028970629248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120936.734649:0:14501:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120936.734657:0:14501:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.734659:0:14501:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789120936.734662:0:14501:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:2.0:1789120936.734724:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:2.0:1789120936.734747:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789120936.734757:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120936.734766:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789120936.734775:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789120936.734777:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468b9991000 from 13 10000000:01000000:2.0:1789120936.734780:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789120936.734807:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120936.734814:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120936.734852:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120936.734865:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970629376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789120936.734891:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120936.734909:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0ecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120936.735847:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970629376 00000100:00100000:3.0:1789120936.735855:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970629376 00000100:00100000:3.0:1789120936.735897:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1789120936.735905:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+21:6515:x1876028970629376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120936.735918:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120936.735932:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f698 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f691 expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.735957:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f691 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.735968:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f698 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f691 expref: 22 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.735978:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f10000, rc 0) 00000100:00100000:3.0:1789120936.736030:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970629376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.736042:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:3.0:1789120936.736090:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970629376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120936.736104:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.736112:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120936.736172:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970629504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120936.736200:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120936.736216:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e13aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120936.736227:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970629504 00000100:00100000:3.0:1789120936.736231:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970629504 00000100:00100000:3.0:1789120936.736249:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1789120936.736255:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970629504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120936.739340:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120936.739383:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947464960 00000100:00100000:1.0:1789120936.739394:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947464960 00000100:00100000:1.0:1789120936.739439:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 418 00000100:00100000:1.0:1789120936.739448:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947464960:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120936.739853:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947464960:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 404us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120936.739873:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 418 00000100:00100000:2.0:1789120936.747405:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120936.747501:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970629504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 11242us (11296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120936.747802:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947465088 00000100:00100000:1.0:1789120936.747812:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947465088 00000100:00100000:1.0:1789120936.747881:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 419 00000100:00100000:1.0:1789120936.747892:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947465088:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120936.748029:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1789120936.748154:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970629504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120936.748409:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970629632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120936.748588:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947465088:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 696us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120936.748596:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 419 00000100:00100000:3.0:1789120936.749192:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120936.749232:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e13aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120936.749255:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970629632 00000100:00100000:3.0:1789120936.749259:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970629632 00000100:00100000:2.0:1789120936.749290:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1789120936.749301:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970629632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120936.749396:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970629632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.750333:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970629632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120936.750582:0:14506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14506:1876028970629760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120936.750631:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:3.0:1789120936.750632:0:14506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120936.750657:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970629760 00000100:00100000:3.0:1789120936.750662:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970629760 00000100:00100000:3.0:1789120936.750702:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1789120936.750709:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:14506:x1876028970629760:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120936.750803:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:14506:x1876028970629760:12345-0@lo:502:llog_process_th.0 Request processed in 93us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.750810:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:3.0:1789120936.750868:0:14506:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120936.750881:0:14506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14506:1876028970629760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120936.750901:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120936.750910:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120936.750913:0:14506:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789120936.750919:0:14506:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468b9991000 00000020:00000080:3.0:1789120936.750922:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789120936.750977:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120936.750981:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120936.750982:0:14506:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789120936.750985:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789120936.750988:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120936.750989:0:14506:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1789120936.750993:0:14506:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468b9991000 00000020:00000080:3.0:1789120936.750995:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789120936.751024:0:14506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14506:1876028970629888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120936.751055:0:14506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120936.751075:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970629888 00000100:00100000:3.0:1789120936.751082:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970629888 00000100:00100000:3.0:1789120936.751104:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1789120936.751110:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:14506:x1876028970629888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789120936.751168:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+22:14506:x1876028970629888:12345-0@lo:502:llog_process_th.0 Request processed in 57us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.751175:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1789120936.751205:0:14506:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120936.751217:0:14506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14506:1876028970629888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789120936.751235:0:14506:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789120936.751240:0:14506:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789120936.751241:0:14506:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1789120936.751245:0:14506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:3.0:1789120936.751292:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:3.0:1789120936.751319:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789120936.751329:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.751338:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789120936.751348:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789120936.751351:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946883582800 from 13 10000000:01000000:3.0:1789120936.751354:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789120936.751376:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.751384:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.751392:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120936.751411:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789120936.751436:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120936.751449:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120936.751460:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970630016 00000100:00100000:3.0:1789120936.751463:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970630016 00000100:00100000:3.0:1789120936.751484:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789120936.751489:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+22:6515:x1876028970630016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120936.751498:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120936.751509:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f6a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f69f expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.751527:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f6a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f69f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.751537:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f6a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f69f expref: 23 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.751546:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f11400, rc 0) 00000100:00100000:3.0:1789120936.751574:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970630016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.751580:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:3.0:1789120936.751607:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789120936.751618:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.751627:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120936.751674:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120936.751699:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120936.751719:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120936.751730:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970630144 00000100:00100000:3.0:1789120936.751733:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970630144 00000100:00100000:3.0:1789120936.751753:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1789120936.751759:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970630144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120936.751855:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970630144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.751862:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000100:00100000:3.0:1789120936.751890:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789120936.751914:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120936.751947:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120936.751975:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120936.752288:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970630272 00000100:00100000:2.0:1789120936.752292:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970630272 00000100:00100000:2.0:1789120936.752337:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:2.0:1789120936.752344:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970630272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120936.752418:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970630272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.752424:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:3.0:1789120936.757679:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789120936.758323:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000040:00080000:1.0:1789120936.760009:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789120936.760376:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947465216 00000100:00100000:2.0:1789120936.760386:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947465216 00000100:00100000:2.0:1789120936.760628:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 426 00000100:00100000:2.0:1789120936.760645:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:11082:x1876028947465216:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789120936.760802:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+12:11082:x1876028947465216:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 158us (2482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.760810:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 426 00000100:00100000:2.0:1789120936.763266:0:14509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14509:1876028970630400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120936.763356:0:14509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120936.763401:0:14509:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0e000 going to sleep for 11 seconds 00000100:00100000:1.0:1789120936.763626:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970630400 00000100:00100000:1.0:1789120936.763633:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970630400 00000100:00100000:1.0:1789120936.763679:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:1.0:1789120936.763688:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:14509:x1876028970630400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789120936.763805:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+23:14509:x1876028970630400:12345-0@lo:502:llog_process_th.0 Request processed in 117us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120936.763812:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:2.0:1789120936.764171:0:14509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14509:1876028970630400:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120936.764203:0:14509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120936.764273:0:14509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.764277:0:14509:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789120936.764283:0:14509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946883582800 00000020:00000080:2.0:1789120936.764286:0:14509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789120936.766991:0:14509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120936.767015:0:14509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.767018:0:14509:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789120936.767021:0:14509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120936.767025:0:14509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.767026:0:14509:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789120936.767032:0:14509:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946883582800 00000020:00000080:2.0:1789120936.767034:0:14509:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789120936.767118:0:14509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14509:1876028970630528:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120936.767206:0:14509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120936.767792:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970630528 00000100:00100000:2.0:1789120936.767799:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970630528 00000100:00100000:2.0:1789120936.767880:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1789120936.767888:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:14509:x1876028970630528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120936.768002:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+23:14509:x1876028970630528:12345-0@lo:502:llog_process_th.0 Request processed in 114us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.768009:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1789120936.768056:0:14509:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0e000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120936.768076:0:14509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14509:1876028970630528:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120936.768102:0:14509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120936.768108:0:14509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.768109:0:14509:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789120936.768113:0:14509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:1.0:1789120936.768609:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:1.0:1789120936.768633:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789120936.768643:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120936.768655:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789120936.768665:0:6515:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789120936.768667:0:6515:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946886899000 from 13 10000000:01000000:1.0:1789120936.768677:0:6515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789120936.768705:0:6515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120936.768714:0:6515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120936.768723:0:6515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120936.768738:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789120936.768771:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120936.768796:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120936.768854:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970630656 00000100:00100000:2.0:1789120936.768858:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970630656 00000100:00100000:2.0:1789120936.768882:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:2.0:1789120936.768887:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+23:6515:x1876028970630656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120936.768896:0:6513:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120936.768907:0:6513:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f6b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a830f6ad expref: -99 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120936.768926:0:6513:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a830f6ad expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120936.768935:0:6513:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f6b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a830f6ad expref: 24 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120936.768943:0:6513:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0e00, rc 0) 00000100:00100000:2.0:1789120936.768973:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970630656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.768979:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00000100:00100000:1.0:1789120936.769042:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789120936.769053:0:6515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120936.769062:0:6515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120936.769106:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120936.769128:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120936.769151:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120936.769188:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970630784 00000100:00100000:2.0:1789120936.769198:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970630784 00000100:00100000:2.0:1789120936.769326:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1789120936.769335:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970630784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120936.769631:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970630784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.769637:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:2.0:1789120936.771911:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120936.771950:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947465344 00000100:00100000:2.0:1789120936.771958:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947465344 00000100:00100000:2.0:1789120936.772006:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 431 00000100:00100000:2.0:1789120936.772016:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:11082:x1876028947465344:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789120936.772145:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:11082:x1876028947465344:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 129us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.772153:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 431 00000100:00100000:1.0:1789120936.774154:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789120936.774428:0:6515:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789120936.774579:0:6515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120936.774653:0:6515:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783e0fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120936.781203:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970630912 00000100:00100000:2.0:1789120936.781559:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970630912 00000100:00100000:2.0:1789120936.783587:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120936.783642:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947465472 00000100:00100000:2.0:1789120936.783650:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947465472 00000100:00100000:2.0:1789120936.783696:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 432 00000100:00100000:2.0:1789120936.783706:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:6186:x1876028947465472:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789120936.783723:0:6512:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120936.783740:0:6512:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1600/0xb74d2367a830f6bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9df expref: -99 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120936.784874:0:6512:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1600/0xb74d2367a830f6bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9df expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120936.784904:0:6512:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1600/0xb74d2367a830f6bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9df expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120936.784914:0:6512:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1600, rc 0) 00000100:00100000:2.0:1789120936.784979:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947465472:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 1274us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.784988:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 432 00000100:00100000:2.0:1789120936.786884:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1789120936.786895:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970630912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120936.787033:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:6515:x1876028970630912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (12454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.787041:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1789120936.787102:0:6515:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:03a1864a-46e4-4762-8a00-3ced97b06903:6515:1876028970630912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120936.790463:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120936.790602:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947465600 00000100:00100000:2.0:1789120936.790611:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947465600 00000100:00100000:2.0:1789120936.790659:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 434 00000100:00100000:2.0:1789120936.790669:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947465600:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789120936.790815:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947465600:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 146us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.790957:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 434 00000100:00100000:2.0:1789120936.791535:0:14512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14512:1876028970631040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120936.791593:0:14512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120936.791629:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970631040 00000100:00100000:2.0:1789120936.791634:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970631040 00000100:00100000:2.0:1789120936.791662:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1789120936.791669:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:14512:x1876028970631040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120936.791767:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:14512:x1876028970631040:12345-0@lo:502:llog_process_th.0 Request processed in 98us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.791774:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1789120936.791859:0:14512:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0e300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120936.791882:0:14512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14512:1876028970631040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120936.791913:0:14512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120936.791924:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.791926:0:14512:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789120936.791935:0:14512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946886899000 00000020:00000080:2.0:1789120936.791937:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789120936.791995:0:14512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120936.792275:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.792278:0:14512:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789120936.792282:0:14512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789120936.792286:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.792287:0:14512:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789120936.792291:0:14512:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946886899000 00000020:00000080:2.0:1789120936.792293:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789120936.793864:0:14512:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14512:1876028970631168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120936.793947:0:14512:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120936.793994:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970631168 00000100:00100000:2.0:1789120936.794001:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970631168 00000100:00100000:2.0:1789120936.794045:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1789120936.794053:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:14512:x1876028970631168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789120936.794154:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:14512:x1876028970631168:12345-0@lo:502:llog_process_th.0 Request processed in 101us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.794167:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:2.0:1789120936.796581:0:14512:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120936.796625:0:14512:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:03a1864a-46e4-4762-8a00-3ced97b06903:14512:1876028970631168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789120936.796666:0:14512:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789120936.796673:0:14512:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789120936.796675:0:14512:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789120936.796680:0:14512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:3.0:1789120936.796893:0:6515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-18 (rc=0) 10000000:01000000:3.0:1789120936.796918:0:6515:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789120936.796930:0:6515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120936.796941:0:6515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120936.803715:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789120936.820960:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120936.821781:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947465728 00000100:00100000:2.0:1789120936.821794:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947465728 00000100:00100000:2.0:1789120936.821863:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 437 00000100:00100000:2.0:1789120936.821873:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947465728:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789120936.822010:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:6186:x1876028947465728:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 138us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.822019:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 437 00000100:00100000:0.0:1789120936.830679:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120936.830728:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947465856 00000100:00100000:2.0:1789120936.830739:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947465856 00000100:00100000:2.0:1789120936.832462:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 438 00000100:00100000:2.0:1789120936.832486:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:11085:x1876028947465856:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789120936.832645:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:11085:x1876028947465856:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 171us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.832655:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 438 00000100:00100000:2.0:1789120936.843091:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120936.843162:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947465984 00000100:00100000:3.0:1789120936.843172:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947465984 00000100:00100000:3.0:1789120936.843226:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 439 00000100:00100000:3.0:1789120936.843236:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:11085:x1876028947465984:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789120936.843395:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:11085:x1876028947465984:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 159us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120936.843403:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 439 00000100:00100000:3.0:1789120936.850460:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120936.850488:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970631296:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789120936.850559:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120936.850974:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970631296 00000100:00100000:2.0:1789120936.850984:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970631296 00000100:00100000:2.0:1789120936.851102:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789120936.851113:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783eca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970631296:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789120936.851143:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120936.851199:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783eca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970631296:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120936.851206:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:0.0:1789120936.851271:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9e940 x1876028970631296/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120952 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120936.851292:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970631296:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789120937.682190:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789120937.810537:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789120937.811014:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789120938.708599:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120939.410708:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120939.410745:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970631424:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120939.410877:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120939.411022:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970631424 00000100:00100000:1.0:1789120939.411033:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970631424 00000100:00100000:1.0:1789120939.411098:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789120939.411108:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970631424:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789120939.411156:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120939.411214:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970631424:12345-0@lo:41:osp-pre-1-0.0 Request processed in 107us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120939.411222:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789120939.411288:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970631424:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120939.412567:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120939.412600:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970631552:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120939.412678:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120939.413100:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970631552 00000100:00100000:2.0:1789120939.413110:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970631552 00000100:00100000:2.0:1789120939.413208:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789120939.413219:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970631552:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789120939.413258:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1789120939.413357:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970631552:12345-0@lo:41:osp-pre-0-1.0 Request processed in 140us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120939.413365:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789120939.413478:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970631552:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1789120939.730213:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120940.754074:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789120940.948720:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:1.0:1789120941.458160:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970631680:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789120941.458283:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120941.458427:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970631680 00000100:00100000:2.0:1789120941.458438:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970631680 00000100:00100000:2.0:1789120941.458527:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1789120941.458543:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970631680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789120941.458588:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120941.461031:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970631680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2477us (2732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120941.461049:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:0.0:1789120941.461090:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120941.461114:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970631808:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120941.461189:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120941.461245:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970632320:0@lo:400:kworker.0 00000100:00100000:0.0:1789120941.461297:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120941.461308:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970631808 00000100:00100000:2.0:1789120941.461319:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970631808 00000100:00100000:3.0:1789120941.461326:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970631936:0@lo:400:kworker.0 00000100:00100000:0.0:1789120941.461327:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970632832:0@lo:400:kworker.0 00000100:00100000:0.0:1789120941.461379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120941.461384:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120941.461409:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789120941.461416:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ecb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970633344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120941.461421:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970632448:0@lo:400:kworker.0 00000100:00100000:2.0:1789120941.461430:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970631808:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120941.461452:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120941.461462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1789120941.461475:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120941.461475:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789120941.461486:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970632192:0@lo:400:kworker.0 00000100:00100000:3.0:1789120941.461488:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970632960:0@lo:400:kworker.0 00000100:00100000:3.0:1789120941.461541:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120941.461542:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970631808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120941.461562:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789120941.461562:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789120941.461567:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970632064:0@lo:400:kworker.0 00000100:00100000:2.0:1789120941.461572:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970633344 00000100:00100000:2.0:1789120941.461575:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970633344 00000100:00100000:3.0:1789120941.461591:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120941.461591:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789120941.461597:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970633344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120941.461608:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120941.461616:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970632576:0@lo:400:kworker.0 00000100:00100000:2.0:1789120941.461634:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970633344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 38us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120941.461637:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120941.461641:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789120941.461653:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970633088:0@lo:400:kworker.0 00000100:00100000:2.0:1789120941.461659:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970631936 00000100:00100000:2.0:1789120941.461662:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970631936 00000100:00100000:3.0:1789120941.461673:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120941.461688:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:2.0:1789120941.461694:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970631936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120941.461704:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970632448 00000100:00100000:3.0:1789120941.461707:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970632448 00000100:00100000:2.0:1789120941.461727:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970631936:12345-0@lo:400:kworker.0 Request processed in 33us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120941.461733:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:3.0:1789120941.461737:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789120941.461743:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970632448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120941.461772:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970632320 00000100:00100000:3.0:1789120941.461776:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970632448:12345-0@lo:400:kworker.0 Request processed in 35us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120941.461776:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970632320 00000100:00100000:3.0:1789120941.461796:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789120941.461797:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970632960 00000100:00100000:2.0:1789120941.461799:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970632960 00000100:00100000:2.0:1789120941.461812:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970632064 00000100:00100000:2.0:1789120941.461814:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970632064 00000100:00100000:3.0:1789120941.461867:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970631936:0@lo:400:kworker.0 00000100:00100000:3.0:1789120941.461881:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970632448:0@lo:400:kworker.0 00000100:00100000:3.0:1789120941.461920:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970632576 00000100:00100000:3.0:1789120941.461923:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970632576 00000100:00100000:3.0:1789120941.461942:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970633088 00000100:00100000:3.0:1789120941.461945:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970633088 00000100:00100000:3.0:1789120941.461959:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789120941.461965:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970632320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120941.462001:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970632320:12345-0@lo:400:kworker.0 Request processed in 36us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120941.462007:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789120941.462019:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789120941.462025:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783eca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970632960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120941.462055:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783eca580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970632960:12345-0@lo:400:kworker.0 Request processed in 30us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120941.462068:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789120941.462080:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789120941.462086:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970632576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120941.462114:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970632576:12345-0@lo:400:kworker.0 Request processed in 29us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120941.462115:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789120941.462123:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789120941.462126:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970633088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120941.462133:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789120941.462138:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970632064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120941.462156:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970633088:12345-0@lo:400:kworker.0 Request processed in 31us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120941.462160:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970632064:12345-0@lo:400:kworker.0 Request processed in 22us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120941.462163:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789120941.462166:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789120941.462183:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970632832 00000100:00100000:3.0:1789120941.462186:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970632832 00000100:00080000:2.0:1789120941.462188:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789120941.462192:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120941.462194:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120941.462196:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120941.462217:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970632064:0@lo:400:kworker.0 00000100:00100000:2.0:1789120941.462228:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970632576:0@lo:400:kworker.0 00010000:00080000:2.0:1789120941.462240:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f6ed00 x1876028970633088/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120941.462250:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f6ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970633088:0@lo:400:kworker.0 00000100:00100000:2.0:1789120941.462272:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970632960:0@lo:400:kworker.0 00000100:00100000:1.0:1789120941.463097:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970631680:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789120941.464075:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789120941.464099:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970632832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120941.464963:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9e08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970632832:12345-0@lo:400:kworker.0 Request processed in 871us (3579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120941.464975:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789120941.473798:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120941.473930:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970632704:0@lo:400:kworker.0 00000100:00100000:0.0:1789120941.474014:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120941.474075:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970633216:0@lo:400:kworker.0 00000100:00100000:0.0:1789120941.474112:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120941.474135:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970632192 00000100:00100000:0.0:1789120941.474178:0:3645:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1789120941.474186:0:3645:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946783ebc780, transno 4294967301 00000100:00100000:0.0:1789120941.474214:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ecb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970633344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120941.474235:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970632320:0@lo:400:kworker.0 00000100:00100000:3.0:1789120941.474250:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970632704 00000100:00100000:0.0:1789120941.474250:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970632832:0@lo:400:kworker.0 00000100:00100000:3.0:1789120941.474270:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970632704 00010000:00080000:0.0:1789120941.474282:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d19680 x1876028970631808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120941.474300:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d19680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970631808:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789120941.474732:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789120941.475096:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970632192 00000100:00100000:2.0:1789120941.475679:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789120941.475695:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970632192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120941.475756:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970633216 00000100:00100000:1.0:1789120941.475761:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970633216 00000100:00100000:1.0:1789120941.475813:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1789120941.475843:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970633216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120941.475883:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970633216:12345-0@lo:400:kworker.0 Request processed in 63us (1770us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120941.475891:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1789120941.475917:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120941.475947:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1789120941.475959:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970632704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120941.475997:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970632704:12345-0@lo:400:kworker.0 Request processed in 43us (1983us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120941.476025:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789120941.477649:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970632192:12345-0@lo:400:kworker.0 Request processed in 1945us (3849us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120941.477687:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789120941.478876:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970632192:0@lo:400:kworker.0 00010000:00080000:0.0:1789120941.478905:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784896580 x1876028970632704/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120941.483783:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970632704:0@lo:400:kworker.0 00010000:00080000:0.0:1789120941.483874:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f6d680 x1876028970633216/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120957 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120941.483887:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f6d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970633216:0@lo:400:kworker.0 00000100:00100000:0.0:1789120941.525695:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120941.525962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120941.526065:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120941.526106:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120941.526129:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120941.526199:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120941.526248:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947466240 00000100:00100000:0.0:1789120941.526269:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947466240 00000100:00100000:1.0:1789120941.526311:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947466752 00000100:00100000:1.0:1789120941.526315:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947466752 00000100:00100000:1.0:1789120941.526345:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947466368 00000100:00100000:0.0:1789120941.526345:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947466624 00000100:00100000:1.0:1789120941.526347:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947466368 00000100:00100000:0.0:1789120941.526347:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947466624 00000100:00100000:1.0:1789120941.526367:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 271 00000100:00100000:1.0:1789120941.526378:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947466240:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120941.526485:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947466240:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 108us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120941.526688:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 272 00000100:00100000:0.0:1789120941.526698:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947466752:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120941.526729:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947466752:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 34us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120941.526737:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 272 00000100:00100000:0.0:1789120941.526770:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 273 00000100:00100000:0.0:1789120941.526776:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947466368:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120941.526808:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947466368:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 33us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120941.526814:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 273 00000100:00100000:0.0:1789120941.526851:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 274 00000100:00100000:0.0:1789120941.526857:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947466624:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120941.526881:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947466624:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120941.526888:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 274 00000100:00080000:0.0:1789120941.526979:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789120941.526984:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120941.527777:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947466112 00000100:00100000:0.0:1789120941.527787:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947466112 00000100:00100000:0.0:1789120941.527869:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 441 00000100:00100000:0.0:1789120941.527878:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2409:x1876028947466112:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120941.527937:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2409:x1876028947466112:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 60us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120941.527945:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 441 00000100:00100000:3.0:1789120941.534315:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947466496 00000100:00100000:3.0:1789120941.534340:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947466496 00000100:00100000:3.0:1789120941.534498:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 90 00000100:00100000:3.0:1789120941.534511:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947466496:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120941.535295:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947466496:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 781us (9327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120941.535308:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 90 00000100:00100000:1.0:1789120941.536750:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 271 00000100:00080000:0.0:1789120941.538001:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789120941.779722:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120941.971158:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120941.971200:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970633472:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789120941.971329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120941.972701:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970633472 00000100:00100000:0.0:1789120941.972719:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970633472 00000100:00100000:0.0:1789120941.972803:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789120941.972816:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970633472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120941.972867:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120941.973335:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970633472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 518us (2003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120941.973345:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00010000:00080000:2.0:1789120941.975360:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9de00 x1876028970633472/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120957 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120941.975401:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970633472:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789120942.802134:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120943.826329:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120944.533785:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970633600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120944.533912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120944.534271:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120944.534284:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970633728:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120944.534325:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120944.535668:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970633600 00000100:00100000:1.0:1789120944.535681:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970633600 00000100:00100000:1.0:1789120944.535759:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970633728 00000100:00100000:1.0:1789120944.535762:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970633728 00000100:00100000:1.0:1789120944.535784:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789120944.535796:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970633600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789120944.535870:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120944.535970:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970633600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120944.535979:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789120944.536000:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789120944.536007:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970633728:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789120944.536026:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1789120944.536065:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970633728:12345-0@lo:41:osp-pre-0-1.0 Request processed in 59us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120944.536071:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789120944.536375:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970633600:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120944.536776:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970633728:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789120944.850171:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120945.874288:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120946.578581:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970634112:0@lo:400:kworker.0 00000100:00100000:3.0:1789120946.578679:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120946.578765:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970634624:0@lo:400:kworker.0 00000100:00100000:3.0:1789120946.578796:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120946.578840:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970635136:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.578844:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970633856:0@lo:400:kworker.0 00000100:00100000:3.0:1789120946.578864:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120946.578885:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120946.578896:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789120946.578902:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970633984:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.578907:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970634368:0@lo:400:kworker.0 00000100:00100000:3.0:1789120946.578925:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120946.578926:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120946.578941:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970634496:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.578941:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970634880:0@lo:400:kworker.0 00000100:00100000:3.0:1789120946.578960:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120946.578963:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120946.578974:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970635008:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.578977:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970635392:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.578992:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120946.578994:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120946.579032:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1789120946.579037:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970634240:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.579060:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120946.579075:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970634752:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.579094:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120946.579108:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970635264:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.579126:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120946.579186:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970634624 00000100:00100000:0.0:1789120946.579194:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970634624 00000100:00100000:0.0:1789120946.579262:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970635136 00000100:00100000:0.0:1789120946.579266:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970635136 00000100:00100000:0.0:1789120946.579278:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970633984 00000100:00100000:0.0:1789120946.579280:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970633984 00000100:00100000:0.0:1789120946.579292:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970634496 00000100:00100000:0.0:1789120946.579294:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970634496 00000100:00100000:0.0:1789120946.579307:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970635008 00000100:00100000:0.0:1789120946.579310:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970635008 00000100:00100000:0.0:1789120946.579322:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970634240 00000100:00100000:0.0:1789120946.579324:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970634240 00000100:00100000:0.0:1789120946.579339:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789120946.579347:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf661a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970634624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.579403:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf661a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970634624:12345-0@lo:400:kworker.0 Request processed in 56us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.579412:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789120946.579432:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789120946.579436:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf6612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970635136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.579462:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf6612c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970635136:12345-0@lo:400:kworker.0 Request processed in 25us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.579466:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:0.0:1789120946.579485:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789120946.579491:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf661680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970633984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.579518:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf661680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970633984:12345-0@lo:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.579524:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789120946.579534:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789120946.579539:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970634496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.579563:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf660000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970634496:12345-0@lo:400:kworker.0 Request processed in 24us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.579569:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789120946.579580:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789120946.579585:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970635008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.579607:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970635008:12345-0@lo:400:kworker.0 Request processed in 23us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.579612:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1789120946.579621:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789120946.579626:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970634240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120946.579652:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970634880 00000100:00100000:0.0:1789120946.579652:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970634240:12345-0@lo:400:kworker.0 Request processed in 26us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120946.579656:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970634880 00000100:00100000:0.0:1789120946.579657:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:0.0:1789120946.579673:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970635392 00000100:00100000:0.0:1789120946.579676:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970635392 00000100:00100000:3.0:1789120946.579681:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970634752 00000100:00100000:3.0:1789120946.579683:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970634752 00000100:00100000:0.0:1789120946.579691:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970635264 00000100:00100000:0.0:1789120946.579693:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970635264 00000100:00100000:3.0:1789120946.579696:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789120946.579701:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970634880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.579705:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789120946.579709:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970635392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120946.579735:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970634880:12345-0@lo:400:kworker.0 Request processed in 34us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120946.579741:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789120946.579744:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970635392:12345-0@lo:400:kworker.0 Request processed in 34us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.579749:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789120946.579756:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789120946.579761:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970634752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120946.579840:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970635520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120946.579878:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120946.579919:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970633856 00000100:00100000:2.0:1789120946.579925:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970633856 00000100:00100000:2.0:1789120946.579959:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1789120946.579965:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970633856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120946.580039:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468ab8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3645:x1876028970633856:12345-0@lo:400:kworker.0 Request processed in 73us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120946.580046:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 442 00000100:00100000:2.0:1789120946.580080:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970634112 00000100:00100000:2.0:1789120946.580084:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970634112 00000100:00100000:2.0:1789120946.580108:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970634368 00000100:00100000:2.0:1789120946.580111:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970634368 00000100:00100000:2.0:1789120946.580126:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789120946.580133:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970634112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120946.580167:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970634112:12345-0@lo:400:kworker.0 Request processed in 35us (1489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120946.580181:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789120946.580193:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789120946.580199:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970634368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120946.580240:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970634368:12345-0@lo:400:kworker.0 Request processed in 41us (1313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120946.580246:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789120946.583971:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970634752:12345-0@lo:400:kworker.0 Request processed in 4200us (4866us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120946.584201:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120946.584233:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970635648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120946.584249:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789120946.584267:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970635264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120946.584287:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120946.584312:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970635264:12345-0@lo:400:kworker.0 Request processed in 53us (5185us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.584319:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1789120946.584338:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970635520 00000100:00100000:1.0:1789120946.584360:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970635520 00000100:00100000:1.0:1789120946.584397:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970635648 00000100:00100000:1.0:1789120946.584400:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970635648 00000100:00100000:1.0:1789120946.584412:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789120946.584419:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970635520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120946.584458:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:0.0:1789120946.584479:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120946.584485:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789120946.584489:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120946.584493:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789120946.584498:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970635520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (4620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120946.584504:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789120946.584517:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1789120946.584523:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1876028970635648:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120946.584535:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970634240:0@lo:400:kworker.0 00002000:00000024:1.0:1789120946.584539:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120946.584547:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848970c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970634752:0@lo:400:kworker.0 00010000:00080000:0.0:1789120946.584563:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b9c39a40 x1876028970635264/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120946.584576:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970635264:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.584589:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970633856:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.584602:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970634368:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.584616:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970634880:0@lo:400:kworker.0 00010000:00080000:0.0:1789120946.584630:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99c7840 x1876028970635392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120946.584639:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970635392:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.584706:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970633984:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.584723:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970634496:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.584737:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970635008:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.584751:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970634112:0@lo:400:kworker.0 00010000:00080000:0.0:1789120946.584766:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784897840 x1876028970634624/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120946.584775:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784897840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970634624:0@lo:400:kworker.0 00010000:00080000:0.0:1789120946.584789:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b9c38b40 x1876028970635136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120962 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120946.584797:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970635136:0@lo:400:kworker.0 00000100:00100000:0.0:1789120946.584942:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970635648:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1789120946.584953:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d192c0 x1876028970635520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120962 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120946.584965:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970635520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120946.585053:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120946.585060:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970635776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120946.585091:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120946.585146:0:8436:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1789120946.585156:0:8436:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1789120946.585311:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970635776 00000100:00100000:0.0:1789120946.585315:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970635776 00000100:00100000:0.0:1789120946.585425:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789120946.585438:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970635776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120946.585455:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120946.585491:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970635776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120946.585496:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3646:x1876028970635648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 40us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.585498:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1789120946.585503:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1789120946.585527:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970635776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120946.590465:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789120946.637551:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120946.637605:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120946.637634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120946.637660:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120946.637684:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120946.637706:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120946.637737:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947467136 00000100:00100000:0.0:1789120946.637749:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947467136 00000100:00100000:0.0:1789120946.637849:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947467392 00000100:00100000:0.0:1789120946.637852:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947467392 00000100:00100000:0.0:1789120946.637866:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947467008 00000100:00100000:0.0:1789120946.637868:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947467008 00000100:00100000:0.0:1789120946.637882:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947467520 00000100:00100000:0.0:1789120946.637885:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947467520 00000100:00100000:0.0:1789120946.637901:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 281 00000100:00100000:0.0:1789120946.637913:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947467136:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120946.638020:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d192c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947467136:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 109us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.638029:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 281 00000100:00100000:0.0:1789120946.638049:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 282 00000100:00100000:0.0:1789120946.638055:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947467392:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120946.638105:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947467392:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 50us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.638113:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 282 00000100:00100000:0.0:1789120946.638126:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 283 00000100:00100000:0.0:1789120946.638132:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947467008:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120946.638153:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947467008:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 22us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.638159:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 283 00000100:00100000:0.0:1789120946.638168:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 284 00000100:00100000:0.0:1789120946.638173:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947467520:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120946.638190:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784897840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947467520:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 17us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.638196:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 284 00000100:00100000:0.0:1789120946.638224:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947467264 00000100:00100000:0.0:1789120946.638227:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947467264 00000100:00100000:0.0:1789120946.638257:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:0.0:1789120946.638263:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947467264:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120946.638285:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947467264:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 23us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120946.638291:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00080000:0.0:1789120946.638310:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789120946.638315:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120946.638317:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789120946.638767:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947466880 00000100:00100000:2.0:1789120946.638774:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947466880 00000100:00100000:2.0:1789120946.638852:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 443 00000100:00100000:2.0:1789120946.638861:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947466880:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120946.638901:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947466880:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 42us (1366us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120946.638908:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 443 00010000:00010000:2.0:1789120946.899903:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789120947.026870:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789120947.029102:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789120947.094677:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970635904:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789120947.094784:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120947.095027:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970635904 00000100:00100000:0.0:1789120947.095038:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970635904 00000100:00100000:0.0:1789120947.095156:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789120947.095167:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970635904:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120947.095196:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120947.095266:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970635904:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120947.095273:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00010000:00080000:0.0:1789120947.095323:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9e940 x1876028970635904/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120947.095345:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970635904:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1789120947.922039:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120948.946527:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120949.650161:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970636160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120949.650311:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120949.650628:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120949.650637:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970636032:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120949.650658:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970636160 00000100:00100000:0.0:1789120949.650670:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970636160 00000100:00100000:3.0:1789120949.650675:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120949.650735:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970636032 00000100:00100000:0.0:1789120949.650739:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970636032 00000100:00100000:0.0:1789120949.650762:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789120949.650774:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970636160:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120949.650780:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789120949.650794:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970636032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789120949.650858:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000004:00000024:0.0:1789120949.650862:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120949.650936:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970636032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 146us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120949.650944:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789120949.651037:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970636160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 266us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120949.651045:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789120949.651661:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970636032:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789120949.651678:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970636160:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789120949.972200:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120950.994065:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120951.698120:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970636672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789120951.698204:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120951.698285:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970636672 00000100:00100000:1.0:1789120951.698293:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970636672 00000100:00100000:2.0:1789120951.698399:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970636800:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120951.698428:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120951.698459:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970636416:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789120951.698915:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120951.698929:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf703c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970636544:0@lo:400:kworker.0 00000100:00100000:2.0:1789120951.698959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120951.699060:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970636800 00000100:00100000:1.0:1789120951.699065:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970636800 00000100:00100000:1.0:1789120951.699090:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789120951.699100:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970636672:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789120951.699131:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120951.699206:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970636672:12345-0@lo:13:osp-pre-0-1.0 Request processed in 107us (1002us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.699212:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789120951.699227:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789120951.699233:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970636800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120951.699248:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120951.699275:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970636800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.699280:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:1.0:1789120951.699294:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789120951.699316:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f6de00 x1876028970636800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120967 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120951.699334:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f6de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970636800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120951.699364:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970636672:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789120951.699405:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120951.699429:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783e59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970636288:0@lo:400:kworker.0 00000100:00100000:1.0:1789120951.699457:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120951.699503:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970636416 00000100:00100000:1.0:1789120951.699507:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970636416 00000100:00100000:3.0:1789120951.699989:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970637312:0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.700020:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120951.700040:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970637824:0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.700060:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120951.700078:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789120951.700083:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970637184:0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.700104:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120951.700121:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970637696:0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.700139:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120951.700174:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970637184 00000100:00100000:3.0:1789120951.700179:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970637184 00000100:00100000:3.0:1789120951.700210:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789120951.700216:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970637184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.700266:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970637184:12345-0@lo:400:kworker.0 Request processed in 50us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.700273:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789120951.700305:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970637184:0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.701080:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970637824 00000100:00100000:3.0:1789120951.701087:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970637824 00000100:00100000:3.0:1789120951.701138:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789120951.701145:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970637824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.701206:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970637824:12345-0@lo:400:kworker.0 Request processed in 61us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.701213:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1789120951.701235:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789120951.701258:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783c2ed00 x1876028970637824/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120951.701270:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970637824:0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.701305:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970636544 00000100:00100000:3.0:1789120951.701308:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970636544 00000100:00100000:3.0:1789120951.702050:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970637312 00000100:00100000:3.0:1789120951.702058:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970637312 00000100:00100000:3.0:1789120951.702087:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970637696 00000100:00100000:3.0:1789120951.702089:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970637696 00000100:00100000:3.0:1789120951.702104:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789120951.702112:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970636544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.702174:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970636544:12345-0@lo:400:kworker.0 Request processed in 52us (3203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.702181:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789120951.702209:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789120951.702215:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970637312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.702248:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970637312:12345-0@lo:400:kworker.0 Request processed in 33us (2227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.702254:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1789120951.702265:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789120951.702271:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970637696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.702294:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970637696:12345-0@lo:400:kworker.0 Request processed in 24us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.702300:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1789120951.702322:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970636288 00000100:00100000:1.0:1789120951.702762:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789120951.702770:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970636416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120951.702789:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120951.702910:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970636416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 140us (3503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.702916:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1789120951.702952:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970636928:0@lo:400:kworker.0 00000100:00100000:1.0:1789120951.702988:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120951.703023:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970637440:0@lo:400:kworker.0 00000100:00100000:1.0:1789120951.703047:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120951.703086:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970636416:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120951.703108:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789120951.703114:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970637056:0@lo:400:kworker.0 00000100:00100000:1.0:1789120951.703136:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120951.703151:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970637568:0@lo:400:kworker.0 00000100:00100000:1.0:1789120951.703182:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120951.703202:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970637440 00000100:00100000:1.0:1789120951.703206:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970637440 00000100:00100000:1.0:1789120951.703228:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970637056 00000100:00100000:1.0:1789120951.703230:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970637056 00000100:00100000:1.0:1789120951.703239:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970637568 00000100:00100000:1.0:1789120951.703241:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970637568 00000100:00100000:1.0:1789120951.703254:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789120951.703260:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970637440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.703281:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970636288 00000100:00100000:1.0:1789120951.703291:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970637440:12345-0@lo:400:kworker.0 Request processed in 32us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.703306:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789120951.703317:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789120951.703318:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1789120951.703322:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970637056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.703335:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970636288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120951.703352:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970637056:12345-0@lo:400:kworker.0 Request processed in 30us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.703358:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1789120951.703364:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970636288:12345-0@lo:400:kworker.0 Request processed in 40us (3907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.703368:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789120951.703370:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1789120951.703373:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970637568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120951.703396:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970637568:12345-0@lo:400:kworker.0 Request processed in 23us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.703401:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:3.0:1789120951.703404:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789120951.703408:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120951.703422:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789120951.703422:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970637056:0@lo:400:kworker.0 00000100:00100000:1.0:1789120951.703431:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970637568:0@lo:400:kworker.0 00010000:00080000:3.0:1789120951.703440:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783c2cb40 x1876028970637696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1789120951.703440:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d21c0 x1876028970637440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120967 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120951.703450:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970637440:0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.703451:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970637696:0@lo:400:kworker.0 00000100:00100000:1.0:1789120951.703458:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783e59680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970636288:0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.703461:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970637312:0@lo:400:kworker.0 00000100:00100000:1.0:1789120951.703505:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970636928 00000100:00100000:1.0:1789120951.703508:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970636928 00000100:00100000:1.0:1789120951.703529:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789120951.703535:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970636928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120951.703569:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970636928:12345-0@lo:400:kworker.0 Request processed in 34us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120951.703584:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789120951.703610:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970636928:0@lo:400:kworker.0 00000100:00100000:2.0:1789120951.703957:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf703c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970636544:0@lo:400:kworker.0 00000100:00100000:3.0:1789120951.764666:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120951.764739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120951.764787:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120951.764813:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947467904 00000100:00100000:3.0:1789120951.764845:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947467904 00000100:00100000:3.0:1789120951.764901:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947467776 00000100:00100000:3.0:1789120951.764905:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947467776 00000100:00100000:3.0:1789120951.764930:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 291 00000100:00100000:3.0:1789120951.764938:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947467904:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120951.765009:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947467904:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 71us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.765017:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 291 00000100:00100000:3.0:1789120951.765036:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 292 00000100:00100000:3.0:1789120951.765042:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947467776:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120951.765067:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947467776:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120951.765073:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 292 00000100:00080000:3.0:1789120951.765095:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789120951.765099:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789120951.765671:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947467648 00000100:00100000:2.0:1789120951.765685:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947467648 00000100:00100000:2.0:1789120951.765726:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 445 00000100:00100000:2.0:1789120951.765734:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947467648:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120951.765764:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468881f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947467648:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 31us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120951.765770:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 445 00000100:00100000:1.0:1789120951.785497:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120951.785544:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120951.785603:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120951.785703:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947468160 00000100:00100000:2.0:1789120951.785703:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947468288 00000100:00100000:3.0:1789120951.785713:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947468160 00000100:00100000:2.0:1789120951.785713:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947468288 00000100:00100000:0.0:1789120951.785791:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947468032 00000100:00100000:0.0:1789120951.785796:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947468032 00000100:00100000:2.0:1789120951.785964:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 293 00000100:00100000:2.0:1789120951.785980:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947468288:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120951.786057:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784892d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947468288:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 83us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120951.786065:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 293 00000100:00100000:2.0:1789120951.787720:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 294 00000100:00100000:2.0:1789120951.787734:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947468160:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120951.787799:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947468160:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 69us (2254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120951.787807:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 294 00000100:00100000:0.0:1789120951.793648:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:0.0:1789120951.793677:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2408:x1876028947468032:12345-192.168.202.32@tcp:9:kworker.0 00000020:00000080:0.0:1789120951.793708:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f5e2 00000100:00080000:0.0:1789120951.793719:0:8434:0:(import.c:65:import_set_state_nolock()) ffff946783dea000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789120951.793776:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:0.0:1789120951.793972:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e59680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+2:2408:x1876028947468032:12345-192.168.202.32@tcp:9:kworker.0 Request processed in 298us (8484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120951.793980:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 27 00010000:00010000:3.0:1789120951.795874:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789120951.801405:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120951.801417:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120951.801421:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1789120952.018663:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120952.210132:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120952.212364:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970637952:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789120952.212443:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120952.213104:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970637952 00000100:00100000:1.0:1789120952.213113:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970637952 00000100:00100000:1.0:1789120952.213190:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1789120952.213200:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784896580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970637952:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789120952.213225:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120952.213282:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784896580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970637952:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120952.213290:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00010000:00080000:0.0:1789120952.213664:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784891680 x1876028970637952/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120952.213684:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970637952:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789120953.043138:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120954.066763:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120954.770148:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120954.770179:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970638080:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120954.770256:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120954.770410:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970638080 00000100:00100000:2.0:1789120954.770418:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970638080 00000100:00100000:2.0:1789120954.770476:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789120954.770486:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970638080:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789120954.770520:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789120954.770562:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970638080:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120954.770582:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1789120954.770877:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120954.770889:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970638208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120954.770920:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120954.770978:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970638208 00000100:00100000:0.0:1789120954.770982:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970638208 00000100:00100000:0.0:1789120954.771007:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789120954.771014:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784896d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970638208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789120954.771031:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1789120954.771065:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784896d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970638208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 51us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120954.771071:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789120954.771108:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970638208:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789120954.771260:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970638080:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120954.829923:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120954.829966:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120954.829996:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120954.830030:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120954.830057:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120954.830082:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947468672 00000100:00100000:2.0:1789120954.830091:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947468672 00000100:00100000:2.0:1789120954.830155:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947468928 00000100:00100000:2.0:1789120954.830158:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947468928 00000100:00100000:2.0:1789120954.830172:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947468544 00000100:00100000:2.0:1789120954.830174:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947468544 00000100:00100000:2.0:1789120954.830186:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947468800 00000100:00100000:2.0:1789120954.830189:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947468800 00000100:00100000:2.0:1789120954.830203:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 295 00000100:00100000:2.0:1789120954.830212:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947468672:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120954.830317:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947468672:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 105us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120954.830325:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 295 00000100:00100000:2.0:1789120954.830341:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 296 00000100:00100000:2.0:1789120954.830348:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947468928:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120954.830373:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947468928:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120954.830380:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 296 00000100:00100000:2.0:1789120954.830392:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 297 00000100:00100000:2.0:1789120954.830397:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf703c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947468544:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120954.830449:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf703c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947468544:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 40us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120954.830456:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 297 00000100:00100000:2.0:1789120954.830469:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 298 00000100:00100000:2.0:1789120954.830476:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947468800:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120954.830499:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eae580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947468800:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120954.830505:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 298 00000100:00100000:3.0:1789120954.831126:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947468416 00000100:00100000:3.0:1789120954.831145:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947468416 00000100:00100000:3.0:1789120954.831189:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 446 00000100:00100000:3.0:1789120954.831206:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947468416:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120954.831258:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947468416:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 53us (1344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120954.831265:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 446 00000100:00080000:1.0:1789120954.831694:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120954.831700:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789120955.091050:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120956.114548:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120956.818023:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120956.818044:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970638336:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789120956.818111:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120956.818294:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970638336 00000100:00100000:0.0:1789120956.818300:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970638336 00000100:00100000:0.0:1789120956.818349:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789120956.818358:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970638336:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789120956.818385:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120956.818439:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970638336:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120956.818447:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1789120956.818464:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789120956.818471:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970638464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120956.818495:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789120956.818514:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120956.818523:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970638464 00000100:00100000:0.0:1789120956.818526:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970638464 00000100:00100000:0.0:1789120956.818547:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1789120956.818552:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970638464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120956.818562:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120956.818587:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848970c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970638464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 34us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120956.818592:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1789120956.818603:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120956.818629:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970638464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120956.818652:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970638336:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120956.819012:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970638592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120956.819037:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120956.819129:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970638592 00000100:00100000:2.0:1789120956.819133:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970638592 00000100:00100000:2.0:1789120956.819166:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789120956.819173:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784895680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970638592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120956.819188:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120956.819216:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784895680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970638592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120956.819221:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1789120956.819360:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789120956.819380:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946782b91a40 x1876028970638592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120972 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120956.819405:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b91a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970638592:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120956.820935:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120956.830579:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970638848:0@lo:400:kworker.0 00000100:00100000:3.0:1789120956.830658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120956.830705:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970638720:0@lo:400:kworker.0 00000100:00100000:3.0:1789120956.830729:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120956.830906:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970638720 00000100:00100000:0.0:1789120956.830915:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970638720 00000100:00100000:0.0:1789120956.830961:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 447 00000100:00100000:0.0:1789120956.830969:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970638720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120956.831018:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a08b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970638720:12345-0@lo:400:kworker.0 Request processed in 49us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120956.831025:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 447 00000100:00100000:2.0:1789120956.831155:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970638848 00000100:00100000:2.0:1789120956.831159:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970638848 00000100:00100000:2.0:1789120956.831189:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789120956.831194:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970638848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120956.831227:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970638848:12345-0@lo:400:kworker.0 Request processed in 33us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120956.831233:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1789120956.831732:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970638848:0@lo:400:kworker.0 00000100:00100000:3.0:1789120956.831743:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970638720:0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.836588:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970639104:0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.836665:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120956.836701:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970639616:0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.836744:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120956.836776:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789120956.836783:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970638976:0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.836807:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120956.836845:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970639488:0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.836867:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120956.836899:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970639104 00000100:00100000:1.0:1789120956.836906:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970639104 00000100:00100000:1.0:1789120956.836949:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970639616 00000100:00100000:1.0:1789120956.836951:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970639616 00000100:00100000:1.0:1789120956.836973:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970639488 00000100:00100000:1.0:1789120956.836977:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970639488 00000100:00100000:1.0:1789120956.836991:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789120956.837000:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970639104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.837053:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970639104:12345-0@lo:400:kworker.0 Request processed in 53us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120956.837060:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1789120956.837077:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789120956.837082:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970639616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.837109:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970639616:12345-0@lo:400:kworker.0 Request processed in 27us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120956.837130:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789120956.837143:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789120956.837149:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970639488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.837176:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970639488:12345-0@lo:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120956.837194:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789120956.837216:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970638976 00000100:00100000:1.0:1789120956.837220:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970638976 00000100:00100000:1.0:1789120956.837243:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789120956.837249:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970638976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.837280:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970638976:12345-0@lo:400:kworker.0 Request processed in 31us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120956.837286:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789120956.837305:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970639360:0@lo:400:kworker.0 00000100:00080000:1.0:1789120956.837312:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120956.837315:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120956.837336:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120956.837342:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970638976:0@lo:400:kworker.0 00000100:00100000:3.0:1789120956.837355:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970639872:0@lo:400:kworker.0 00010000:00080000:1.0:1789120956.837356:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5e1c0 x1876028970639488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120956.837366:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970639488:0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.837375:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970639104:0@lo:400:kworker.0 00000100:00100000:3.0:1789120956.837376:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120956.837384:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970639616:0@lo:400:kworker.0 00000100:00100000:3.0:1789120956.837405:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789120956.837411:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970639232:0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.837422:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970639360 00000100:00100000:1.0:1789120956.837425:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970639360 00000100:00100000:3.0:1789120956.837433:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120956.837449:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970639744:0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.837449:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789120956.837455:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970639360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120956.837470:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120956.837481:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970639360:12345-0@lo:400:kworker.0 Request processed in 26us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120956.837486:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:3.0:1789120956.837489:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970639360:0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.837497:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970639744 00000100:00100000:1.0:1789120956.837505:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970639744 00000100:00100000:3.0:1789120956.837508:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970639872 00000100:00100000:3.0:1789120956.837516:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970639872 00000100:00100000:1.0:1789120956.837527:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789120956.837533:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970639744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120956.837543:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789120956.837548:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970639872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120956.837565:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970639744:12345-0@lo:400:kworker.0 Request processed in 32us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120956.837571:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1789120956.837574:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970639872:12345-0@lo:400:kworker.0 Request processed in 27us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120956.837580:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1789120956.837587:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120956.837589:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120956.837591:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120956.837596:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970639232 00000100:00100000:3.0:1789120956.837599:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970639232 00000100:00100000:3.0:1789120956.837619:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789120956.837625:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970639232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120956.837653:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ebc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970639232:12345-0@lo:400:kworker.0 Request processed in 29us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120956.837659:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789120956.837684:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970639232:0@lo:400:kworker.0 00010000:00080000:3.0:1789120956.837696:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5ed00 x1876028970639744/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120956.837704:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970639744:0@lo:400:kworker.0 00010000:00080000:0.0:1789120956.837888:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5f480 x1876028970639872/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120956.837897:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970639872:0@lo:400:kworker.0 00000100:00100000:0.0:1789120956.878315:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120956.878358:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120956.878400:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120956.878430:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120956.878478:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120956.878507:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947469184 00000100:00100000:0.0:1789120956.878516:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947469184 00000100:00100000:0.0:1789120956.878569:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947469440 00000100:00100000:0.0:1789120956.878573:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947469440 00000100:00100000:0.0:1789120956.878587:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947469312 00000100:00100000:0.0:1789120956.878590:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947469312 00000100:00100000:0.0:1789120956.878601:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947469568 00000100:00100000:0.0:1789120956.878603:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947469568 00000100:00100000:0.0:1789120956.878617:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 305 00000100:00100000:0.0:1789120956.878634:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947469184:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120956.878724:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784897c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947469184:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 90us (417us total) trans 0 rc 0/0 00000100:00080000:1.0:1789120956.878726:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120956.878733:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120956.878735:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 305 00000100:00100000:1.0:1789120956.878759:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 306 00000100:00100000:1.0:1789120956.878847:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947469440:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120956.878854:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947469056 00000100:00100000:3.0:1789120956.878860:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947469056 00000100:00100000:1.0:1789120956.878880:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947469440:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 113us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120956.878899:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 448 00000100:00100000:3.0:1789120956.878908:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947469056:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120956.878940:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947469056:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 34us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120956.878946:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 448 00000100:00100000:0.0:1789120956.884163:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 307 00000100:00100000:0.0:1789120956.884195:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947469312:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120956.884490:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947469312:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 312us (6056us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120956.884498:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 307 00000100:00100000:0.0:1789120956.884532:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 308 00000100:00100000:0.0:1789120956.884540:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947469568:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120956.884569:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947469568:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (6089us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120956.884575:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 308 00000100:00100000:1.0:1789120956.895480:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 306 00010000:00010000:1.0:1789120957.147702:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789120957.266490:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789120957.268502:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789120957.345581:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970640000:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789120957.345686:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120957.345800:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970640000 00000100:00100000:1.0:1789120957.345810:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970640000 00000100:00100000:1.0:1789120957.345891:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1789120957.345902:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970640000:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789120957.345932:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120957.345984:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970640000:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120957.346013:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00010000:00080000:1.0:1789120957.346066:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783ebc3c0 x1876028970640000/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120957.346089:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970640000:0@lo:13:osp-pre-1-1.0 00000001:00100000:3.0:1789120957.849167:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000020:00000080:3.0:1789120957.849181:0:8428:0:(genops.c:885:class_export_put()) final put ffff946783de8000/3dde8702-0a22-4cb8-87f3-66b167299fdd 00000020:00000080:1.0:1789120957.849455:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff946783de8000/3dde8702-0a22-4cb8-87f3-66b167299fdd for lustre-OST0000 00000020:00000080:1.0:1789120957.849532:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783dea000 for lustre-OST0000 00010000:00010000:2.0:1789120958.171159:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120959.187933:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120959.890188:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789120959.890213:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970640128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120959.890286:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120959.890359:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970640128 00000100:00100000:1.0:1789120959.890367:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970640128 00000100:00100000:1.0:1789120959.890414:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789120959.890422:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970640128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789120959.890456:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120959.890518:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970640128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 96us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120959.890526:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1789120959.890574:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970640128:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120959.897391:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789120959.897426:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970640256:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789120959.897514:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120959.897700:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970640256 00000100:00100000:3.0:1789120959.897709:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970640256 00000100:00100000:3.0:1789120959.897767:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789120959.897781:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970640256:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120959.897841:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789120959.897913:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970640256:12345-0@lo:41:osp-pre-0-1.0 Request processed in 135us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120959.897922:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789120959.897977:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970640256:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789120960.211106:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120961.245006:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120961.938377:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970640384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120961.938451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120961.938580:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970640384 00000100:00100000:0.0:1789120961.938588:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970640384 00000100:00100000:0.0:1789120961.938662:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789120961.938673:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970640384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120961.938704:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120961.938750:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970640384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120961.938757:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789120961.938804:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970640384:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789120961.938957:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120961.939588:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120961.939602:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970640512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120961.939642:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120961.939785:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970640512 00000100:00100000:2.0:1789120961.939791:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970640512 00000100:00100000:2.0:1789120961.939878:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789120961.939887:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970640512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120961.939909:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120961.939951:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970640512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120961.939958:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00010000:00080000:2.0:1789120961.939990:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783cfb0c0 x1876028970640512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120977 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120961.940005:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970640512:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789120961.940144:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120961.940367:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120961.940378:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970640640:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120961.940412:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120961.940572:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970640896:0@lo:400:kworker.0 00000100:00100000:0.0:1789120961.940604:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120961.940624:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970641408:0@lo:400:kworker.0 00000100:00100000:0.0:1789120961.940658:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120961.940676:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970641920:0@lo:400:kworker.0 00000100:00100000:0.0:1789120961.940699:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120961.940716:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789120961.940721:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970640768:0@lo:400:kworker.0 00000100:00100000:0.0:1789120961.940747:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120961.940768:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970641280:0@lo:400:kworker.0 00000100:00100000:0.0:1789120961.940795:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120961.940809:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970641792:0@lo:400:kworker.0 00000100:00100000:0.0:1789120961.940849:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120961.940877:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970640896 00000100:00100000:0.0:1789120961.940881:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970640896 00000100:00100000:0.0:1789120961.940910:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970641408 00000100:00100000:0.0:1789120961.940913:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970641408 00000100:00100000:0.0:1789120961.940928:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970641792 00000100:00100000:0.0:1789120961.940930:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970641792 00000100:00100000:0.0:1789120961.940944:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789120961.940950:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970640896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120961.940987:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970640896:12345-0@lo:400:kworker.0 Request processed in 37us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120961.940993:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:0.0:1789120961.941006:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789120961.941012:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970641408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120961.941200:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970640768 00000100:00100000:3.0:1789120961.941204:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970640768 00000100:00100000:3.0:1789120961.941235:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1789120961.941242:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970640768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120961.941274:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970640768:12345-0@lo:400:kworker.0 Request processed in 33us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120961.941288:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:3.0:1789120961.941325:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1789120961.941332:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970641792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120961.941364:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970641792:12345-0@lo:400:kworker.0 Request processed in 33us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120961.941370:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00080000:3.0:1789120961.941393:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120961.941397:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120961.941407:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970641024:0@lo:400:kworker.0 00000100:00100000:3.0:1789120961.941444:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120961.941464:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970641536:0@lo:400:kworker.0 00000100:00100000:3.0:1789120961.941486:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120961.941504:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789120961.941510:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970641152:0@lo:400:kworker.0 00000100:00100000:3.0:1789120961.941531:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120961.941541:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970641664:0@lo:400:kworker.0 00000100:00100000:3.0:1789120961.941559:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120961.941576:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970641536 00000100:00100000:3.0:1789120961.941579:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970641536 00000100:00100000:3.0:1789120961.941601:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970641152 00000100:00100000:3.0:1789120961.941605:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970641152 00000100:00100000:3.0:1789120961.941616:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970641664 00000100:00100000:3.0:1789120961.941618:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970641664 00000100:00100000:3.0:1789120961.941632:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789120961.941637:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970641536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120961.941684:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970641536:12345-0@lo:400:kworker.0 Request processed in 46us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120961.941696:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789120961.941710:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789120961.941715:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891481e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970641152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120961.941742:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891481e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970641152:12345-0@lo:400:kworker.0 Request processed in 27us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120961.941748:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:3.0:1789120961.941760:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:3.0:1789120961.941766:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891481680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970641664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120961.941791:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891481680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970641664:12345-0@lo:400:kworker.0 Request processed in 26us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120961.941796:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:3.0:1789120961.941810:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789120961.941813:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789120961.941860:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970641152:0@lo:400:kworker.0 00000100:00100000:3.0:1789120961.941871:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970641664:0@lo:400:kworker.0 00010000:00080000:3.0:1789120961.941881:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf75cf00 x1876028970641536/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120961.941891:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970641536:0@lo:400:kworker.0 00000100:00100000:0.0:1789120961.942088:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970641408:12345-0@lo:400:kworker.0 Request processed in 1076us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120961.942095:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1789120961.942119:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970641920 00000100:00100000:0.0:1789120961.942123:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970641920 00000100:00100000:0.0:1789120961.942154:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789120961.942161:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970641920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120961.942191:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970641920:12345-0@lo:400:kworker.0 Request processed in 31us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120961.942197:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789120961.942225:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970640768:0@lo:400:kworker.0 00010000:00080000:0.0:1789120961.942237:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf75ed00 x1876028970641792/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120961.942245:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970641792:0@lo:400:kworker.0 00000100:00100000:0.0:1789120961.942256:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970640896:0@lo:400:kworker.0 00000100:00100000:0.0:1789120961.942264:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970641408:0@lo:400:kworker.0 00010000:00080000:0.0:1789120961.942274:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf75e1c0 x1876028970641920/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120961.942282:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970641920:0@lo:400:kworker.0 00000100:00100000:1.0:1789120961.943098:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970641280 00000100:00100000:1.0:1789120961.943106:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970641280 00000100:00100000:1.0:1789120961.943162:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970641024 00000100:00100000:1.0:1789120961.943166:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970641024 00000100:00100000:1.0:1789120961.943182:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789120961.943189:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970641280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120961.943258:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970641280:12345-0@lo:400:kworker.0 Request processed in 70us (2462us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120961.943265:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789120961.943281:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789120961.943287:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970641024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120961.943322:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914821c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970641024:12345-0@lo:400:kworker.0 Request processed in 36us (1878us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120961.943328:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789120961.943350:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970640640 00000100:00100000:1.0:1789120961.943354:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970640640 00000100:00100000:1.0:1789120961.943383:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789120961.943390:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970640640:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789120961.943407:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120961.943441:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970640640:12345-0@lo:13:osp-pre-0-1.0 Request processed in 52us (3029us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120961.943447:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789120961.943481:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970641024:0@lo:400:kworker.0 00000100:00100000:1.0:1789120961.943500:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970640640:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789120961.943537:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970641280:0@lo:400:kworker.0 00000100:00080000:3.0:1789120961.943861:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789120961.943866:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120962.005609:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120962.005651:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120962.005690:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120962.005724:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120962.005750:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120962.005775:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947469952 00000100:00100000:2.0:1789120962.005785:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947469952 00000100:00100000:2.0:1789120962.005867:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947470208 00000100:00100000:2.0:1789120962.005871:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947470208 00000100:00100000:2.0:1789120962.005886:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947469824 00000100:00100000:2.0:1789120962.005888:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947469824 00000100:00100000:2.0:1789120962.005899:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947470080 00000100:00100000:2.0:1789120962.005901:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947470080 00000100:00100000:2.0:1789120962.005918:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 315 00000100:00100000:2.0:1789120962.005928:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947469952:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120962.006144:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 316 00000100:00100000:0.0:1789120962.006156:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947470208:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120962.006239:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 317 00000100:00100000:1.0:1789120962.006250:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947469824:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120962.006306:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947469952:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 378us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.006314:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 315 00000100:00100000:2.0:1789120962.006332:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 318 00000100:00100000:2.0:1789120962.006338:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947470080:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120962.006399:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947469696 00000100:00100000:3.0:1789120962.006404:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947469696 00000100:00100000:3.0:1789120962.006439:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 450 00000100:00100000:3.0:1789120962.006445:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947469696:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120962.014868:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947470208:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 8700us (9161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120962.014908:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 316 00000100:00080000:0.0:1789120962.014995:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120962.015001:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789120962.015387:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947469824:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 9136us (9659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120962.015397:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 317 00000100:00100000:2.0:1789120962.017269:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947470080:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 10919us (11507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120962.017285:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 318 00000100:00100000:3.0:1789120962.023463:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947469696:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 17001us (17848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120962.023481:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 450 00010000:00010000:2.0:1789120962.259967:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120962.450359:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120962.454147:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970642048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789120962.454215:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120962.455116:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970642048 00000100:00100000:0.0:1789120962.455125:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970642048 00000100:00100000:0.0:1789120962.455196:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789120962.455203:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970642048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120962.455228:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120962.455286:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970642048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 83us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120962.455292:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00010000:00080000:3.0:1789120962.455399:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf706580 x1876028970642048/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120962.455415:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970642048:0@lo:13:osp-pre-1-1.0 00000001:02000400:0.0:1789120962.833553:0:14773:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 06:02:41 (1789120961) 00010000:00010000:0.0:1789120963.289388:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120964.307364:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120964.613803:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120964.614038:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947470336 00000100:00100000:3.0:1789120964.614058:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947470336 00000100:00100000:3.0:1789120964.614144:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:3.0:1789120964.614156:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:11377:x1876028947470336:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120964.614176:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120964.614202:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f6c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9e6 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120964.614270:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f6c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120964.614284:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120964.614298:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120964.614350:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789120964.614365:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120964.614409:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120964.614436:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f6c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9e6 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120964.614455:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9e6 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120964.614464:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94688864ad00) 00010000:00010000:3.0:1789120964.614466:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120964.614470:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f10800, rc 0) 00000100:00100000:3.0:1789120964.614546:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:11377:x1876028947470336:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 393us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120964.614554:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00080000:0.0:1789120964.615318:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120964.625879:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120964.625988:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947470464 00000100:00100000:0.0:1789120964.625997:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947470464 00000100:00100000:0.0:1789120964.626072:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:0.0:1789120964.626083:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:11378:x1876028947470464:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120964.626107:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120964.626129:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f6d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9ed expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626207:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626222:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626247:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626261:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626268:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626274:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626335:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f6e5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626344:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626350:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120964.626391:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789120964.626394:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789120964.626415:0:6518:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f6e5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626425:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626432:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626450:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626456:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120964.626459:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626467:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626478:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94688864ad00) 00010000:00010000:0.0:1789120964.626482:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120964.626486:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626491:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626503:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626509:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626514:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626519:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120964.626522:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626538:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626547:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9468c1bfa000) 00010000:00010000:0.0:1789120964.626549:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120964.626552:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626559:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626591:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f6d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9ed expref: 8 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626604:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f6e5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9ed expref: 7 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.626611:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9468c1bfa500) 00010000:00010000:0.0:1789120964.626613:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120964.626615:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23c00, rc 0) 00000100:00100000:0.0:1789120964.626684:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:11378:x1876028947470464:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 602us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120964.626692:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:2.0:1789120964.629480:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120964.630390:0:6529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947470592 00000100:00100000:0.0:1789120964.630402:0:6529:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947470592 00000100:00100000:0.0:1789120964.630549:0:6529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:0.0:1789120964.630562:0:6529:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:11378:x1876028947470592:12345-192.168.202.32@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789120964.630726:0:6529:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:11378:x1876028947470592:12345-192.168.202.32@tcp:900:lhsmtool_posix.0 Request processed in 165us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120964.630735:0:6529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:2.0:1789120964.637366:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120964.637431:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947470848 00000100:00100000:0.0:1789120964.637441:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947470848 00000100:00100000:0.0:1789120964.637505:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:0.0:1789120964.637517:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:11378:x1876028947470848:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120964.637540:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120964.637703:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f6ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9f4 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.637777:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6f3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.637792:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.637803:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.637877:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6fa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.637886:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120964.637893:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638108:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2800/0xb74d2367a830f701 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638132:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2800/0xb74d2367a830f701 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638140:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2800/0xb74d2367a830f701 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120964.638150:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1789120964.638232:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6f3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638238:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6f3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638243:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638247:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120964.638249:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6f3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638254:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6f3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638263:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9468c1bfa500) 00010000:00010000:1.0:1789120964.638265:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120964.638269:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638273:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f6f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638296:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6fa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638300:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6fa lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638304:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638307:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120964.638310:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6fa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638315:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6fa lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638323:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9468c1bfa000) 00010000:00010000:1.0:1789120964.638325:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120964.638328:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6fa lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.638333:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f6fa lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.639305:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f6ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9f4 expref: 10 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.639328:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2800/0xb74d2367a830f701 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9f4 expref: 9 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120964.639349:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:1.0:1789120964.639351:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120964.639354:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2800, rc 0) 00000100:00100000:1.0:1789120964.639434:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:11378:x1876028947470848:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1918us (2078us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789120964.639444:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:2.0:1789120964.643802:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120964.644506:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947470976 00000100:00100000:1.0:1789120964.644517:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947470976 00000100:00100000:1.0:1789120964.644634:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:1.0:1789120964.644645:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:11378:x1876028947470976:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789120964.644766:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:11378:x1876028947470976:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 Request processed in 122us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120964.644775:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:0.0:1789120964.652675:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120964.652851:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947471104 00000100:00100000:2.0:1789120964.652860:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947471104 00000100:00100000:2.0:1789120964.654870:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:2.0:1789120964.654887:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:11378:x1876028947471104:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789120964.655838:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1789120964.660676:0:6518:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5731us 00000100:00100000:0.0:1789120964.678949:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:11378:x1876028947471104:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 Request processed in 24055us (26270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120964.678967:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:3.0:1789120965.010100:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789120965.010125:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970642176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789120965.010254:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120965.010325:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970642176 00000100:00100000:3.0:1789120965.010333:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970642176 00000100:00100000:3.0:1789120965.010380:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789120965.010390:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891481a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970642176:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120965.010425:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1789120965.010475:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891481a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970642176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120965.010482:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789120965.010528:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970642176:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789120965.013432:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120965.013454:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970642304:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120965.013523:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120965.013587:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970642304 00000100:00100000:3.0:1789120965.013612:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970642304 00000100:00100000:3.0:1789120965.013661:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789120965.013670:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970642304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789120965.013704:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789120965.013750:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914803c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970642304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120965.013757:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789120965.013803:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891483c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970642304:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789120965.334735:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789120965.458492:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1789120965.459489:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789120966.354279:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120966.931684:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120966.931891:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947471232 00000100:00100000:3.0:1789120966.931901:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947471232 00000100:00100000:3.0:1789120966.931961:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:3.0:1789120966.931973:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:11421:x1876028947471232:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120966.931994:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120966.932029:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f70f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7e9fb expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932096:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f716 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932112:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f716 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932126:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f716 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932152:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f71d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932160:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f71d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932167:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f71d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932209:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f716 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932216:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f716 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932222:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f716 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932228:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f10e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120966.932233:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f716 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932241:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f716 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932253:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94688864ad00) 00010000:00010000:3.0:1789120966.932257:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120966.932261:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f716 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932268:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f716 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932289:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f71d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932296:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f71d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932302:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f71d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932308:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120966.932311:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f71d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932317:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f71d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932325:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9468886f6d00) 00010000:00010000:3.0:1789120966.932327:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120966.932330:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f71d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932335:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f71d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932369:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f70f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9fb expref: 10 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932380:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94688864ad00) 00010000:00010000:3.0:1789120966.932382:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120966.932391:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f70f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9fb expref: 10 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120966.932402:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f11000, rc 0) 00000100:00100000:3.0:1789120966.932457:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:11421:x1876028947471232:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 487us (784us total) trans 0 rc 301/301 00000100:00100000:3.0:1789120966.932465:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00080000:0.0:1789120966.932594:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120966.949367:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120966.949449:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947471488 00000100:00100000:0.0:1789120966.949459:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947471488 00000100:00100000:0.0:1789120966.949525:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:0.0:1789120966.949536:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:11421:x1876028947471488:12345-192.168.202.32@tcp:36:lfs.0 00010000:00010000:0.0:1789120966.949595:0:9342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120966.949625:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f6c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9e6 expref: 9 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.949644:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94688864ad00) 00010000:00010000:0.0:1789120966.949657:0:9342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120966.949729:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f724 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.949744:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f724 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.949757:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f724 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.949771:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.949814:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950012:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950556:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950570:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950579:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789120966.950597:0:9342:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000035380eb7 reply state 00000000d90d5bbc transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950608:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950614:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:0.0:1789120966.950617:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789120966.950622:0:9342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789120966.950627:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789120966.950635:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f724 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950641:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f724 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950648:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f724 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950663:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120966.950667:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f724 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950676:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f724 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950686:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c1bfa300) 00010000:00010000:0.0:1789120966.950689:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120966.950693:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f724 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950699:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830f724 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789120966.950713:0:9342:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000035380eb7 reply state 00000000d90d5bbc transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950721:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120966.950727:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9468c1bfa900) 00010000:00010000:0.0:1789120966.950729:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789120966.950731:0:9342:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1789120966.951249:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:11421:x1876028947471488:12345-192.168.202.32@tcp:36:lfs.0 Request processed in 1710us (1888us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789120966.951258:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:3.0:1789120967.058163:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970642432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120967.058251:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120967.058464:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970642432 00000100:00100000:0.0:1789120967.058474:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970642432 00000100:00100000:0.0:1789120967.058545:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789120967.058572:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970642432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789120967.058601:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120967.058648:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970642432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120967.058655:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789120967.058701:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970642432:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789120967.058764:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120967.059027:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891480780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970642560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120967.059058:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120967.059142:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970642560 00000100:00100000:3.0:1789120967.059146:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970642560 00000100:00100000:3.0:1789120967.059192:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789120967.059199:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970642560:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120967.059212:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120967.059245:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970642560:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120967.059251:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:0.0:1789120967.060256:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120967.060279:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970643072:0@lo:400:kworker.0 00000100:00100000:0.0:1789120967.060332:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120967.060373:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970643584:0@lo:400:kworker.0 00000100:00100000:0.0:1789120967.060395:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120967.060437:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891483840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970644096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120967.060462:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120967.060514:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891480780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970642560:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120967.060548:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789120967.060555:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970642688:0@lo:400:kworker.0 00000100:00100000:0.0:1789120967.060585:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120967.060624:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970643200:0@lo:400:kworker.0 00000100:00100000:0.0:1789120967.060650:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120967.060670:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970643712:0@lo:400:kworker.0 00000100:00100000:0.0:1789120967.060691:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120967.060719:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970642688 00000100:00100000:0.0:1789120967.060732:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970642688 00000100:00100000:3.0:1789120967.060884:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970643072 00000100:00100000:3.0:1789120967.060888:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970643072 00000100:00100000:3.0:1789120967.060917:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970643584 00000100:00100000:3.0:1789120967.060920:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970643584 00000100:00100000:3.0:1789120967.060944:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970643712 00000100:00100000:3.0:1789120967.060946:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970643712 00000100:00100000:3.0:1789120967.060962:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789120967.060969:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970643072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120967.061034:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970643072:12345-0@lo:400:kworker.0 Request processed in 65us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120967.061052:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1789120967.061070:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789120967.061077:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970643584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120967.061107:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970643584:12345-0@lo:400:kworker.0 Request processed in 31us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120967.061113:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1789120967.061127:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1789120967.061134:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970643712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120967.061158:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970643712:12345-0@lo:400:kworker.0 Request processed in 26us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120967.061163:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1789120967.061337:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970642816:0@lo:400:kworker.0 00000100:00100000:1.0:1789120967.061369:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120967.061397:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970643328:0@lo:400:kworker.0 00000100:00100000:1.0:1789120967.061417:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120967.061431:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970643840:0@lo:400:kworker.0 00000100:00100000:1.0:1789120967.061451:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120967.061469:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789120967.061474:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970642944:0@lo:400:kworker.0 00000100:00100000:1.0:1789120967.061551:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120967.061576:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970643456:0@lo:400:kworker.0 00000100:00100000:1.0:1789120967.061598:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120967.061607:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970643968:0@lo:400:kworker.0 00000100:00100000:1.0:1789120967.061622:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120967.061648:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970643840 00000100:00100000:1.0:1789120967.061652:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970643840 00000100:00100000:1.0:1789120967.061681:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970643968 00000100:00100000:1.0:1789120967.061683:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970643968 00000100:00100000:1.0:1789120967.061702:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789120967.061708:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970643840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120967.061742:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970643840:12345-0@lo:400:kworker.0 Request processed in 34us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120967.061747:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789120967.061760:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789120967.061765:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970643968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120967.061890:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970642816 00000100:00100000:2.0:1789120967.061894:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970642816 00000100:00100000:2.0:1789120967.061916:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789120967.061923:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970642816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120967.061965:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970642816:12345-0@lo:400:kworker.0 Request processed in 42us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120967.061980:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1789120967.061992:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970643328 00000100:00100000:2.0:1789120967.061995:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970643328 00000100:00100000:2.0:1789120967.062015:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970643456 00000100:00100000:2.0:1789120967.062032:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970643456 00000100:00100000:2.0:1789120967.062052:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789120967.062057:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970643328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120967.062087:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970643328:12345-0@lo:400:kworker.0 Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120967.062093:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1789120967.062106:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1789120967.062112:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970643456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120967.062145:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970643456:12345-0@lo:400:kworker.0 Request processed in 33us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120967.062152:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1789120967.062383:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970643968:12345-0@lo:400:kworker.0 Request processed in 616us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120967.062393:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789120967.062420:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970643200 00000100:00100000:1.0:1789120967.062425:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970643200 00000100:00100000:1.0:1789120967.062447:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970642944 00000100:00100000:1.0:1789120967.062450:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970642944 00000100:00100000:1.0:1789120967.062464:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789120967.062470:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970643200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120967.062505:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970643200:12345-0@lo:400:kworker.0 Request processed in 36us (1855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120967.062511:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789120967.062530:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789120967.062536:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970642944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120967.062561:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970642944:12345-0@lo:400:kworker.0 Request processed in 26us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120967.062566:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789120967.062613:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970642944:0@lo:400:kworker.0 00010000:00080000:1.0:1789120967.062625:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468914f21c0 x1876028970643456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120967.062635:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970643456:0@lo:400:kworker.0 00010000:00080000:1.0:1789120967.062643:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468914f2580 x1876028970643968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120967.062651:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970643968:0@lo:400:kworker.0 00000100:00100000:1.0:1789120967.062661:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970642816:0@lo:400:kworker.0 00000100:00100000:1.0:1789120967.062669:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970643328:0@lo:400:kworker.0 00010000:00080000:1.0:1789120967.062677:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468914f1680 x1876028970643840/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789120983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120967.062684:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970643840:0@lo:400:kworker.0 00000100:00100000:0.0:1789120967.063391:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1789120967.063410:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970642688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120967.063467:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970642688:12345-0@lo:400:kworker.0 Request processed in 64us (2881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120967.063473:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:0.0:1789120967.063542:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970644096 00000100:00100000:0.0:1789120967.063548:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970644096 00000100:00100000:0.0:1789120967.063592:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789120967.063599:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970644096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120967.063620:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120967.063652:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970644096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (3189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120967.063658:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:0.0:1789120967.063673:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120967.063677:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789120967.063680:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120967.063709:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99b0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970642688:0@lo:400:kworker.0 00000100:00100000:0.0:1789120967.063720:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970643200:0@lo:400:kworker.0 00010000:00080000:0.0:1789120967.063732:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468914f1e00 x1876028970643712/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120967.063740:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970643712:0@lo:400:kworker.0 00000100:00100000:0.0:1789120967.063751:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970643072:0@lo:400:kworker.0 00000100:00100000:0.0:1789120967.063761:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970643584:0@lo:400:kworker.0 00010000:00080000:0.0:1789120967.063769:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946891483840 x1876028970644096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789120983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789120967.063806:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891483840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970644096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120967.093962:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120967.094083:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947471616 00000100:00100000:2.0:1789120967.094095:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947471616 00000100:00100000:2.0:1789120967.094165:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:2.0:1789120967.094177:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:11429:x1876028947471616:12345-192.168.202.32@tcp:101:lctl.0 00010000:00010000:2.0:1789120967.094201:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120967.094226:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f739 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea02 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.094299:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f740 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.094313:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f740 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.094341:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f740 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120967.094391:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789120967.094395:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789120967.094440:0:6518:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f740 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.094467:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f739 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea02 expref: 12 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.094488:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f740 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea02 expref: 11 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.094496:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:2.0:1789120967.094498:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789120967.094502:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0600, rc 0) 00000100:00100000:2.0:1789120967.094569:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:11429:x1876028947471616:12345-192.168.202.32@tcp:101:lctl.0 Request processed in 394us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120967.094576:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:2.0:1789120967.119224:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120967.119267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120967.119298:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120967.119336:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120967.119427:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947472000 00000100:00100000:0.0:1789120967.119438:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947472000 00000100:00100000:0.0:1789120967.119510:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947471872 00000100:00100000:0.0:1789120967.119513:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947471872 00000100:00100000:0.0:1789120967.119530:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947472128 00000100:00100000:0.0:1789120967.119532:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947472128 00000100:00100000:0.0:1789120967.119549:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 325 00000100:00100000:0.0:1789120967.119558:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947472000:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120967.119628:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947472000:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 72us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120967.119635:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 325 00000100:00100000:0.0:1789120967.119651:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 326 00000100:00100000:0.0:1789120967.119657:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947471872:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120967.119677:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947471872:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 20us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120967.119682:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 326 00000100:00100000:0.0:1789120967.119691:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 327 00000100:00100000:0.0:1789120967.119696:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947472128:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120967.119716:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947472128:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 20us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120967.119721:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 327 00000100:00080000:2.0:1789120967.120051:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789120967.120056:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120967.120217:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947471744 00000100:00100000:3.0:1789120967.120222:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947471744 00000100:00100000:3.0:1789120967.120267:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 452 00000100:00100000:3.0:1789120967.120275:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947471744:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120967.120323:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947471744:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 49us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120967.120330:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 452 00000100:00100000:2.0:1789120967.217234:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120967.217340:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947472256 00000100:00100000:3.0:1789120967.217350:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947472256 00000100:00100000:3.0:1789120967.217476:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:3.0:1789120967.217488:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:11435:x1876028947472256:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789120967.217509:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120967.217533:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f747 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea09 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217624:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f74e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217640:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f74e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217652:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f74e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217664:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f755 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217671:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217677:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217780:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f75c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217789:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f75c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217796:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f75c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120967.217860:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789120967.217864:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120967.217909:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f75c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217935:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f74e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217942:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f74e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217948:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f74e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217953:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120967.217956:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f74e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217963:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f74e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217973:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:3.0:1789120967.217976:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120967.217980:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f74e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.217987:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f74e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.218001:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f755 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.218007:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f755 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.218013:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.218036:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f10e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120967.218039:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f755 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.218046:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f755 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.218055:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9468c1bfa900) 00010000:00010000:3.0:1789120967.218057:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120967.218060:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f755 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.218065:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f755 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.218093:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f747 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea09 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.218107:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f75c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea09 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.218114:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120967.218116:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789120967.218118:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f10800, rc 0) 00000100:00100000:3.0:1789120967.218185:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:11435:x1876028947472256:12345-192.168.202.32@tcp:101:bash.0 Request processed in 699us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120967.218194:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:0.0:1789120967.224458:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120967.224608:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947472512 00000100:00100000:1.0:1789120967.224618:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947472512 00000100:00100000:1.0:1789120967.224706:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:1.0:1789120967.224736:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:11435:x1876028947472512:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789120967.224758:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120967.224779:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f763 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea10 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.224921:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f76a lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.224935:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f76a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.224946:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f76a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.224984:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.224991:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.224998:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789120967.225361:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789120967.225506:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f778 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225517:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f778 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225524:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f778 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225556:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f76a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225574:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f76a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225581:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f76a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225587:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120967.225592:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f76a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225601:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f76a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225613:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:1.0:1789120967.225617:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120967.225622:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f76a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225627:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f76a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120967.225640:0:6518:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000005921884d reply state 0000000047df093b transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225649:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225655:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468852bf000) 00010000:00010000:1.0:1789120967.225658:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789120967.225660:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789120967.225688:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f763 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea10 expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225710:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f778 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea10 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.225718:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468852bfb00) 00010000:00010000:1.0:1789120967.225721:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120967.225723:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3200, rc 0) 00000100:00100000:1.0:1789120967.225805:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:11435:x1876028947472512:12345-192.168.202.32@tcp:101:bash.0 Request processed in 1071us (1356us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789120967.225814:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:2.0:1789120967.233993:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120967.234188:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947472640 00000100:00100000:3.0:1789120967.234205:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947472640 00000100:00100000:0.0:1789120967.234357:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:0.0:1789120967.234366:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2408:x1876028947472640:12345-192.168.202.32@tcp:8:bash.0 00010000:00080000:0.0:1789120967.234404:0:9116:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:0.0:1789120967.234436:0:9116:0:(genops.c:1385:class_connect()) connect: client 3dde8702-0a22-4cb8-87f3-66b167299fdd, cookie 0xb74d2367a830f786 00002000:00100000:0.0:1789120967.234449:0:9116:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3dde8702-0a22-4cb8-87f3-66b167299fdd/ffff9468853fb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789120967.234461:0:9116:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789120967.234539:0:9116:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789120967.234570:0:9116:0:(import.c:65:import_set_state_nolock()) ffff9468853f9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789120967.234641:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2408:x1876028947472640:12345-192.168.202.32@tcp:8:bash.0 Request processed in 273us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120967.234650:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:0.0:1789120967.239976:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120967.240959:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947472768 00000100:00100000:1.0:1789120967.240974:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947472768 00000100:00100000:1.0:1789120967.241074:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:1.0:1789120967.241086:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:0:x1876028947472768:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789120967.241108:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120967.241133:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830f78d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea17 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789120967.241159:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789120967.241178:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1789120967.241183:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120967.241192:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830f78d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea17 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.241214:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830f78d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea17 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.241248:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3400, rc 0) 00000100:00100000:1.0:1789120967.241459:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:0:x1876028947472768:12345-192.168.202.32@tcp:101:bash.0 Request processed in 375us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120967.241467:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00080000:2.0:1789120967.242381:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120967.247243:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120967.247351:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947472896 00000100:00100000:0.0:1789120967.247361:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947472896 00000100:00100000:0.0:1789120967.247547:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:0.0:1789120967.247558:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:11435:x1876028947472896:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120967.247575:0:9116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120967.247595:0:9116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea1e expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.247623:0:9116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830f78d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea17 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.247632:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120967.247636:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120967.247681:0:9116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 8 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.247743:0:9116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830f78d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea17 expref: 8 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.247757:0:9116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830f78d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea17 expref: 8 pid: 8435 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120967.247771:0:9116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9116:1876028970644224:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120967.247898:0:9116:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835da840 going to sleep for 11 seconds 00000100:00100000:0.0:1789120967.258372:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120967.258487:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947473024 00000100:00100000:2.0:1789120967.258496:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947473024 00010000:00010000:2.0:1789120967.258544:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830f78d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea17 expref: 9 pid: 8435 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120967.258589:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:2.0:1789120967.258599:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2411:x1876028947473024:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120967.258616:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120967.258641:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830f78d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea17 expref: 9 pid: 8435 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.258657:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830f78d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea17 expref: 9 pid: 8435 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.258688:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120967.258693:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120967.258703:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 9 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.258731:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 9 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.258772:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 9 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120967.258817:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1876028970644352:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789120967.258943:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852cbcc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789120967.260293:0:9116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830f78d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea17 expref: 9 pid: 8435 timeout: 517 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120967.260315:0:9116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f61c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9116:1876028970644224:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120967.260347:0:9116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 8 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.260360:0:9116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23e00, rc 0) 00000100:00100000:1.0:1789120967.260422:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:11435:x1876028947472896:12345-192.168.202.32@tcp:101:bash.0 Request processed in 12865us (13189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120967.260432:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:2.0:1789120967.264733:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f30c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1876028970644352:192.168.202.32@tcp:105: 00010000:00010000:2.0:1789120967.264765:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120967.265032:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947473024:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 6431us (6667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120967.265044:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:2.0:1789120967.275569:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120967.275672:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947473280 00000100:00100000:1.0:1789120967.275682:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947473280 00000100:00100000:1.0:1789120967.275809:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:1.0:1789120967.275955:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:11435:x1876028947473280:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:0.0:1789120967.277547:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:11435:x1876028947473280:12345-192.168.202.32@tcp:35:bash.0 Request processed in 1719us (1978us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1789120967.277559:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00010000:00010000:0.0:1789120967.378083:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120967.398928:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120967.399027:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947473536 00000100:00100000:3.0:1789120967.399037:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947473536 00000100:00100000:3.0:1789120967.399108:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:3.0:1789120967.399120:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:11445:x1876028947473536:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120967.399145:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120967.399177:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f79b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea25 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120967.399278:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789120967.399401:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f79b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea25 expref: 18 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.399414:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:3.0:1789120967.399417:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120967.399422:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f79b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea25 expref: 18 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.399436:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f11000, rc 0) 00000100:00100000:3.0:1789120967.399503:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:11445:x1876028947473536:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 385us (594us total) trans 4294967315 rc 301/301 00000100:00100000:3.0:1789120967.399510:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:2.0:1789120967.402005:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120967.402122:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947473792 00000100:00100000:0.0:1789120967.402130:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947473792 00000100:00100000:0.0:1789120967.402208:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:0.0:1789120967.402218:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:11445:x1876028947473792:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789120967.402459:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:11445:x1876028947473792:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 241us (461us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789120967.402466:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000040:00080000:0.0:1789120967.506704:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1789120967.507760:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789120967.511618:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120967.512059:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947473920 00000100:00100000:3.0:1789120967.512071:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947473920 00000100:00100000:3.0:1789120967.512271:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:3.0:1789120967.512292:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:11451:x1876028947473920:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120967.512318:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120967.512354:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f7a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea2c expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.512425:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f7b0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.512439:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.512451:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120967.512495:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789120967.512499:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120967.512519:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f7b0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.512547:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f7a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea2c expref: 20 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.512567:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f7b0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea2c expref: 19 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.512575:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120967.512578:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120967.512582:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f10e00, rc 0) 00000100:00100000:3.0:1789120967.512650:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:11451:x1876028947473920:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 369us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120967.512657:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:1.0:1789120967.534124:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120967.534286:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947474176 00000100:00100000:0.0:1789120967.534296:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947474176 00000100:00100000:0.0:1789120967.534373:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:0.0:1789120967.534385:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:11451:x1876028947474176:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789120967.534410:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120967.534430:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830f7b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea33 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.534540:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f7be lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.534556:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f7be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.534568:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f7be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120967.534581:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789120967.534716:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830f7b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea33 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.534734:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f7be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea33 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.534744:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468852bfb00) 00010000:00010000:0.0:1789120967.534747:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120967.534751:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23200, rc 0) 00000100:00100000:0.0:1789120967.534856:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b0780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:11451:x1876028947474176:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 472us (742us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1789120967.534866:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:2.0:1789120967.539724:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120967.539794:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120967.540075:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947474432 00000100:00100000:0.0:1789120967.540106:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947474432 00000100:00100000:0.0:1789120967.540192:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789120967.540204:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:2410:x1876028947474432:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120967.540224:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789120967.540268:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947474560 00010000:00010000:0.0:1789120967.540268:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f7be lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea33 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120967.540284:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947474560 00010000:00010000:0.0:1789120967.540301:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468852bfb00) 00010000:00010000:0.0:1789120967.540308:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120967.540363:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:1.0:1789120967.540374:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:11451:x1876028947474560:12345-192.168.202.32@tcp:101:lfs.0 00000100:00100000:0.0:1789120967.540385:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:2410:x1876028947474432:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 180us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120967.540412:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00010000:00010000:1.0:1789120967.540428:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120967.540449:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f7cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea3a expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.540539:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f7d3 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.540551:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f7d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.540561:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f7d3 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120967.540571:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789120967.540675:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f7cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea3a expref: 23 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.540691:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f7d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea3a expref: 22 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.540697:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468852bfb00) 00010000:00010000:1.0:1789120967.540699:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789120967.540702:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3c00, rc 0) 00000100:00100000:1.0:1789120967.540757:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:11451:x1876028947474560:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 386us (963us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1789120967.540762:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:2.0:1789120967.559354:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120967.559450:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947474688 00000100:00100000:0.0:1789120967.559464:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947474688 00000100:00100000:0.0:1789120967.559550:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:0.0:1789120967.559563:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947474688:12345-192.168.202.32@tcp:1:lfs.0 00010000:00010000:0.0:1789120967.559629:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.559659:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 7 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.559670:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120967.559676:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789120967.559682:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.559770:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 7 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.559807:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 7 pid: 9116 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120967.559869:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876028970644480:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120967.560005:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835dab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120967.565295:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f5e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876028970644480:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120967.565329:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120967.571133:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970644608:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789120967.571219:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120967.571339:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970644608 00000100:00100000:0.0:1789120967.571346:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970644608 00000100:00100000:0.0:1789120967.571412:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789120967.571423:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970644608:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120967.571446:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120967.575739:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120967.575985:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947474816 00000100:00100000:3.0:1789120967.576028:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947474816 00002000:00100000:3.0:1789120967.576097:0:8438:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9468914f2d00 x1876028947474816/t0(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:498/0 lens 504/0 e 0 to 0 dl 1789120978 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789120967.576110:0:8438:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468914f2d00 with x1876028947474816 ext(0->12) 00010000:00010000:3.0:1789120967.576121:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 8 pid: 9116 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.576141:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 8 pid: 9116 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120967.576149:0:8438:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9468914f2d00 00000100:00100000:3.0:1789120967.576195:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:3.0:1789120967.576208:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2411:x1876028947474816:12345-192.168.202.32@tcp:4:lfs.0 00000100:00100000:0.0:1789120967.576343:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1cc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970644608:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4918us (5119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120967.576356:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789120967.576717:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970644608:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1789120967.588800:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000100:00100000:3.0:1789120967.590089:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f2d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2411:x1876028947474816:12345-192.168.202.32@tcp:4:lfs.0 Request processed in 13870us (14347us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789120967.590107:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00002000:00100000:3.0:1789120967.590125:0:8438:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x2:0x0] (0->12) req@ffff9468914f2d00 x1876028947474816/t4294967300(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:498/0 lens 504/448 e 0 to 0 dl 1789120978 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789120967.590135:0:8438:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468914f2d00 with x1876028947474816 ext(0->12) 00010000:00010000:3.0:1789120967.590149:0:8438:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 9 pid: 9116 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.590180:0:8438:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 9 pid: 9116 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120967.590209:0:8438:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9468914f2d00 00000100:00100000:0.0:1789120967.597320:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120967.597692:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947474944 00000100:00100000:2.0:1789120967.597708:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947474944 00010000:00010000:2.0:1789120967.597766:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 9 pid: 9116 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120967.598137:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:2.0:1789120967.598148:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2412:x1876028947474944:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120967.598308:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789120967.598330:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789120967.598333:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1789120966 00002000:00010000:2.0:1789120967.598336:0:6505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb atime from disk: 0 -> 1789120967 00002000:00010000:2.0:1789120967.598338:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1789120966 00002000:00010000:2.0:1789120967.598341:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789120967.598349:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 9 pid: 9116 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.598364:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 9 pid: 9116 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.598386:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c908438/0xb74d2367a830f794 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea1e expref: 9 pid: 9116 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.598476:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120967.598481:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120967.598488:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.598500:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.598586:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120967.598656:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835eac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947474944:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 509us (1352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120967.598671:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 65 00010000:00010000:0.0:1789120967.608268:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.608289:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.608325:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.608351:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.608360:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.608368:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789120967.608372:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.608381:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.608478:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.608551:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a830f7e1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120967.608773:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947474688:12345-192.168.202.32@tcp:1:lfs.0 Request processed in 49207us (49430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120967.608792:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:0.0:1789120967.633676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120967.634604:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947475200 00000100:00100000:2.0:1789120967.634619:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947475200 00000100:00100000:2.0:1789120967.634748:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:2.0:1789120967.634770:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:11451:x1876028947475200:12345-192.168.202.32@tcp:35:lfs.0 00000004:00010000:2.0:1789120967.634909:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f7d3 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea3a expref: 22 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120967.637386:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1789120967.637470:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789120967.640881:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1789120967.640988:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.641023:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f778 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea10 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.641034:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.641084:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f778 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea10 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120967.641103:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f778 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea10 expref: 26 pid: 6518 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120967.641140:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1876028970644736:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120967.641278:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852cb540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120967.649250:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120967.649337:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947475328 00000100:00100000:1.0:1789120967.649349:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947475328 00010000:00010000:1.0:1789120967.649406:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f778 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea10 expref: 27 pid: 6518 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120967.649459:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:1.0:1789120967.649471:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:2411:x1876028947475328:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120967.649490:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120967.649499:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f778 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea10 expref: 27 pid: 6518 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.649515:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f778 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea10 expref: 27 pid: 6518 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.649545:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468852bfb00) 00010000:00010000:1.0:1789120967.649552:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.649563:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.649572:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.649596:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120967.649678:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f2580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:2411:x1876028947475328:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 208us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120967.649708:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 66 00010000:00010000:0.0:1789120967.651233:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f778 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea10 expref: 26 pid: 6518 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120967.651290:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f0f00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1876028970644736:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120967.651322:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.651332:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.651338:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120967.651496:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1789120967.651636:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1789120967.651768:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1876028970644864:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789120967.652206:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120967.652374:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468918caf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120967.652444:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970644864 00000100:00100000:3.0:1789120967.652453:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970644864 00000100:00100000:3.0:1789120967.652514:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789120967.652526:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1876028970644864:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789120967.652640:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6521:x1876028970644864:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120967.652649:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789120967.652747:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f6580 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1876028970644864:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789120967.653178:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:3.0:1789120967.660499:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914830c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1876028970644992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789120967.660614:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120967.660677:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468999d1000 going to sleep for 11 seconds 00000100:00100000:0.0:1789120967.660778:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970644992 00000100:00100000:0.0:1789120967.660788:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970644992 00000100:00100000:0.0:1789120967.660899:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789120967.660912:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1876028970644992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789120967.661161:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6521:x1876028970644992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 252us (547us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789120967.661169:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789120967.661371:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914830c0 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1876028970644992:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789120967.661457:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:1.0:1789120967.661514:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.661526:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.661534:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.661541:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120967.661546:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.661554:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.661573:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468852bfb00) 00010000:00010000:1.0:1789120967.661577:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789120967.661582:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.661588:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f7e8 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789120967.661726:0:6521:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789120967.661803:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1789120967.661816:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417850994790ns, next at 418850992010ns, rc = 0 00000001:00080000:1.0:1789120967.661896:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:1.0:1789120967.661993:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468852bfb00) 00010000:00010000:1.0:1789120967.661997:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789120967.662006:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f7d3 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea3a expref: 30 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120967.662170:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:11451:x1876028947475200:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 27412us (28513us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789120967.662179:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000020:00080000:1.0:1789120967.662184:0:6521:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789120967.671601:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120967.671707:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947475456 00000100:00100000:3.0:1789120967.671720:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947475456 00000100:00100000:3.0:1789120967.671806:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:3.0:1789120967.671863:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:11451:x1876028947475456:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120967.671901:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120967.671946:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f7ef lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea41 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.672035:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f7ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea41 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.672054:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f7ef lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea41 expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120967.672103:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:3.0:1789120967.672107:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789120967.672112:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f11000, rc 0) 00000100:00100000:3.0:1789120967.672199:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:11451:x1876028947475456:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 382us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120967.672207:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:2.0:1789120967.678524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120967.678639:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947475712 00000100:00100000:0.0:1789120967.678652:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947475712 00000100:00100000:0.0:1789120967.678736:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:0.0:1789120967.678749:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:11451:x1876028947475712:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789120967.679162:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913fc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+31:11451:x1876028947475712:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 413us (660us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789120967.679170:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:1.0:1789120967.805065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120967.805187:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947475968 00000100:00100000:0.0:1789120967.805198:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947475968 00000100:00100000:0.0:1789120967.805281:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:0.0:1789120967.805293:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+31:11461:x1876028947475968:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789120967.805327:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120967.805356:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830f7f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea48 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120967.805490:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1789120967.806292:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830f7f6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea48 expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.806313:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:0.0:1789120967.806316:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789120967.806322:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830f7f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea48 expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.806341:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23400, rc 0) 00000100:00100000:2.0:1789120967.815877:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:11461:x1876028947475968:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 10564us (10807us total) trans 4294967329 rc 301/301 00000100:00100000:2.0:1789120967.815895:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:2.0:1789120967.819943:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120967.820129:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947476096 00000100:00100000:1.0:1789120967.820144:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947476096 00000100:00100000:1.0:1789120967.820229:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:1.0:1789120967.820241:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:11461:x1876028947476096:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:1.0:1789120967.820361:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f804 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820385:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f804 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820402:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f804 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820415:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f80b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820423:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f80b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820451:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f80b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820546:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f812 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820553:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f812 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820560:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f812 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120967.820710:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f812 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820725:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f804 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820732:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f804 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820738:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f804 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820745:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120967.820750:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f804 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820856:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f804 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820873:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:1.0:1789120967.820885:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120967.820892:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f804 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820902:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f804 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820919:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f80b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820924:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f80b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820930:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f80b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820935:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120967.820937:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f80b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820943:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f80b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820951:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468852bf000) 00010000:00010000:1.0:1789120967.820953:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120967.820956:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f80b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820960:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f80b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820969:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f812 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820983:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f812 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820989:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f812 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.820993:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120967.820996:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f812 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.821002:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f812 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.821020:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120967.821023:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120967.821027:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f812 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.821032:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f812 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120967.821144:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:11461:x1876028947476096:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 902us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120967.821155:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:1.0:1789120967.843797:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120967.844316:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947476352 00000100:00100000:0.0:1789120967.844331:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947476352 00000100:00100000:0.0:1789120967.844438:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:0.0:1789120967.844458:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:11461:x1876028947476352:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789120967.844851:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:11461:x1876028947476352:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 395us (1068us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789120967.844879:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:2.0:1789120967.902501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120967.906239:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947476608 00000100:00100000:0.0:1789120967.906262:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947476608 00000100:00100000:0.0:1789120967.906384:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:0.0:1789120967.906403:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:11464:x1876028947476608:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789120967.906448:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120967.906674:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830f819 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea4f expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.906782:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f820 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.906801:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f820 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.906816:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f820 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.906882:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830f827 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.906891:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830f827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.906899:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830f827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.907245:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830f82e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.907288:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830f82e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120967.907296:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830f82e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120967.907310:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789120967.907907:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f820 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.907919:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f820 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.907940:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f820 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.907948:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120967.907953:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f820 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.907962:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f820 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.907990:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:1.0:1789120967.907994:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120967.908000:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f820 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.908008:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830f820 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.908035:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830f827 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.908043:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830f827 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.908049:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830f827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.908055:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120967.908058:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830f827 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.908074:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830f827 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.908084:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468852bf000) 00010000:00010000:1.0:1789120967.908086:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120967.908090:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830f827 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.908096:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830f827 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.908160:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830f819 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea4f expref: 36 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.908178:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830f82e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea4f expref: 35 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.908186:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120967.908189:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120967.908192:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22000, rc 0) 00000100:00100000:1.0:1789120967.908304:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:11464:x1876028947476608:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1904us (6344us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789120967.908315:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:2.0:1789120967.926125:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120967.926645:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947476736 00000100:00100000:1.0:1789120967.926660:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947476736 00000100:00100000:1.0:1789120967.928922:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:1.0:1789120967.928955:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:11464:x1876028947476736:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:1.0:1789120967.929105:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f83c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.929127:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f83c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.929139:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f83c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.929190:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f83c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.929198:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f83c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.929205:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f83c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.929213:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120967.929218:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f83c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.929228:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f83c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.929243:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120967.929246:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120967.929252:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f83c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120967.929258:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a830f83c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120967.930344:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:11464:x1876028947476736:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 1392us (4219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120967.930361:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:3.0:1789120967.934870:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120967.935270:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947476992 00000100:00100000:0.0:1789120967.935284:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947476992 00000100:00100000:0.0:1789120967.935517:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:0.0:1789120967.935531:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:11464:x1876028947476992:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789120967.935911:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+36:11464:x1876028947476992:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 382us (1055us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1789120967.936151:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:3.0:1789120968.291447:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120968.292190:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947477248 00000100:00100000:0.0:1789120968.292208:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947477248 00000100:00100000:0.0:1789120968.292347:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:0.0:1789120968.292361:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+36:11495:x1876028947477248:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:0.0:1789120968.292399:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1789120968.292675:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789120968.292731:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830f843 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea56 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120968.292968:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830f84a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120968.292987:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830f84a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120968.293058:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830f84a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120968.293074:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789120968.293437:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830f843 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea56 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120968.293461:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830f84a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea56 expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120968.293471:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:0.0:1789120968.293475:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120968.293479:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22a00, rc 0) 00000100:00100000:0.0:1789120968.293576:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:11495:x1876028947477248:12345-192.168.202.32@tcp:101:cat.0 Request processed in 1218us (2146us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1789120968.293586:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:3.0:1789120968.299789:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120968.300437:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947477504 00000100:00100000:0.0:1789120968.300451:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947477504 00000100:00100000:0.0:1789120968.300532:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:0.0:1789120968.300544:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:11495:x1876028947477504:12345-192.168.202.32@tcp:35:cat.0 00000100:00100000:0.0:1789120968.301317:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:11495:x1876028947477504:12345-192.168.202.32@tcp:35:cat.0 Request processed in 770us (1537us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789120968.301328:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:3.0:1789120968.303725:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120968.307684:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947477632 00000100:00100000:2.0:1789120968.307704:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947477632 00000100:00100000:2.0:1789120968.307847:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:2.0:1789120968.307860:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:2411:x1876028947477632:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120968.307882:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120968.308039:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830f84a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea56 expref: 39 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.308067:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:2.0:1789120968.308074:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120968.308268:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:2411:x1876028947477632:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 409us (4558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120968.308278:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:3.0:1789120968.379677:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120968.379874:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947477888 00000100:00100000:1.0:1789120968.379887:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947477888 00000100:00100000:1.0:1789120968.379977:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:1.0:1789120968.379990:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:11501:x1876028947477888:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:1.0:1789120968.380036:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120968.380040:0:11088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789120968.380079:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f7b0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea2c expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.380105:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:1.0:1789120968.380111:0:11088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120968.380129:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f858 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea5d expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.380284:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.380299:0:11088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830f82e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea4f expref: 38 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.380309:0:11088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.380353:0:11088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830f82e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea4f expref: 38 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.380391:0:11088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830f82e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea4f expref: 38 pid: 11088 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120968.380410:0:11088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970645120:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789120968.380551:0:11088:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030300 going to sleep for 11 seconds 00000100:00100000:3.0:1789120968.385647:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120968.385789:0:11088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970645120:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120968.385872:0:11088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120968.385965:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947478016 00000100:00100000:2.0:1789120968.385974:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947478016 00010000:00010000:2.0:1789120968.386034:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830f82e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea4f expref: 39 pid: 11088 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120968.386077:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:2.0:1789120968.386088:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:2412:x1876028947478016:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120968.386108:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120968.386115:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830f82e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea4f expref: 39 pid: 11088 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.386127:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830f82e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea4f expref: 39 pid: 11088 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.386164:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830f82e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea4f expref: 39 pid: 11088 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.386182:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:2.0:1789120968.386187:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.386198:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.386206:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.386256:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120968.386328:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:2412:x1876028947478016:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 241us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120968.386337:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00010000:00010000:3.0:1789120968.386611:0:11088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120968.386620:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120968.386643:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789120968.386898:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830f858 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea5d expref: 39 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120968.387029:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea5d expref: 38 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120968.387040:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:3.0:1789120968.387043:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789120968.387056:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2600, rc 0) 00000100:00100000:3.0:1789120968.387097:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:11501:x1876028947477888:12345-192.168.202.32@tcp:101:dd.0 Request processed in 7110us (7438us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1789120968.387105:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:3.0:1789120968.390897:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120968.391025:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947478144 00000100:00100000:1.0:1789120968.391037:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947478144 00000100:00100000:1.0:1789120968.391115:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:1.0:1789120968.391129:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891483840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:11501:x1876028947478144:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:1.0:1789120968.391175:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120968.391207:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f86d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea64 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.391257:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f874 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.391275:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.391290:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f874 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.391463:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f86d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea64 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.391496:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f874 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea64 expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.391506:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120968.391510:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789120968.391515:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3a00, rc 0) 00000100:00100000:1.0:1789120968.391596:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891483840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:11501:x1876028947478144:12345-192.168.202.32@tcp:101:dd.0 Request processed in 469us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120968.391604:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:0.0:1789120968.395963:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120968.396198:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947478400 00000100:00100000:3.0:1789120968.396212:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947478400 00000100:00100000:3.0:1789120968.396283:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:3.0:1789120968.396294:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:11501:x1876028947478400:12345-192.168.202.32@tcp:36:dd.0 00010000:00010000:3.0:1789120968.396618:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120968.396639:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120968.396654:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789120968.396704:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:3.0:1789120968.396727:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009b5b5166 reply state 00000000e7ba6a34 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120968.396741:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120968.396749:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:3.0:1789120968.396752:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789120968.396771:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789120968.396936:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+42:11501:x1876028947478400:12345-192.168.202.32@tcp:36:dd.0 Request processed in 642us (988us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1789120968.396945:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 62 00000020:00080000:3.0:1789120968.396969:0:6520:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789120968.402189:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120968.818709:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120968.819304:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947478528 00000100:00100000:1.0:1789120968.819322:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947478528 00000100:00100000:1.0:1789120968.819404:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:1.0:1789120968.819419:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+42:11516:x1876028947478528:12345-192.168.202.32@tcp:101:stat.0 00010000:00010000:1.0:1789120968.819458:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120968.819488:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f882 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea6b expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.819589:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f889 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.819609:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f889 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.819627:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f889 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.819664:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f890 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.819673:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.819680:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.819783:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.820551:0:11088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea5d expref: 43 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.820561:0:11088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.820613:0:11088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea5d expref: 43 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.820633:0:11088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea5d expref: 43 pid: 11088 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120968.820651:0:11088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970645248:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789120968.820803:0:11088:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030300 going to sleep for 11 seconds 00000100:00100000:0.0:1789120968.826526:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120968.826660:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947478784 00000100:00100000:2.0:1789120968.826673:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947478784 00000100:00100000:2.0:1789120968.826769:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789120968.826784:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+44:6184:x1876028947478784:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789120968.827290:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+45:6184:x1876028947478784:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 506us (775us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789120968.827299:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:1.0:1789120968.830816:0:11088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970645248:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120968.830880:0:11088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120968.833338:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120968.833598:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947478912 00000100:00100000:2.0:1789120968.833613:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947478912 00010000:00010000:2.0:1789120968.833676:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea5d expref: 45 pid: 11088 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120968.833737:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:2.0:1789120968.833750:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+45:2412:x1876028947478912:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120968.833784:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120968.833792:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea5d expref: 45 pid: 11088 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.833807:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea5d expref: 45 pid: 11088 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.833884:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f85f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea5d expref: 45 pid: 11088 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.833967:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:2.0:1789120968.833974:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.833985:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.833993:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120968.834046:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120968.834118:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+44:2412:x1876028947478912:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 369us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120968.834127:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00010000:00010000:1.0:1789120968.835463:0:11088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835481:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120968.835564:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789120968.835571:0:11088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789120968.835632:0:11088:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835652:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835664:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f889 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835672:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f889 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835679:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f889 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835685:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120968.835690:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f889 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835698:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f889 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835713:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:1.0:1789120968.835733:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120968.835740:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f889 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835746:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f889 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835780:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f890 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835786:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f890 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835791:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f890 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835796:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120968.835799:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f890 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835805:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f890 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835813:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468852bf000) 00010000:00010000:1.0:1789120968.835815:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120968.835818:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f890 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835885:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f890 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835933:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f882 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea6b expref: 44 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835967:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea6b expref: 43 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.835975:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120968.835977:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120968.835979:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3000, rc 0) 00000100:00100000:1.0:1789120968.836074:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:11516:x1876028947478528:12345-192.168.202.32@tcp:101:stat.0 Request processed in 16657us (17378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120968.836085:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:0.0:1789120968.916686:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120968.916807:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947479168 00000100:00100000:1.0:1789120968.916844:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947479168 00000100:00100000:1.0:1789120968.916927:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:1.0:1789120968.916939:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:11522:x1876028947479168:12345-192.168.202.32@tcp:36:truncate.0 00010000:00010000:1.0:1789120968.917030:0:9342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120968.917066:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f897 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea6b expref: 43 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.917090:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120968.917095:0:9342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120968.917338:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.917354:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.917366:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789120968.917433:0:9342:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1789120968.917458:0:9342:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d3a34d18 reply state 0000000027231f36 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.917473:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120968.917480:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120968.917483:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789120968.917486:0:9342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120968.918056:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+45:11522:x1876028947479168:12345-192.168.202.32@tcp:36:truncate.0 Request processed in 1115us (1383us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1789120968.918067:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 64 00000020:00080000:1.0:1789120968.918073:0:9342:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789120969.050315:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120969.050479:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947479296 00000100:00100000:2.0:1789120969.050492:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947479296 00000100:00100000:2.0:1789120969.050635:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:2.0:1789120969.050647:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+45:11536:x1876028947479296:12345-192.168.202.32@tcp:101:stat.0 00010000:00010000:2.0:1789120969.050680:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120969.050986:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f8a5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea72 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051087:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f8ac lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051132:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f8ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051159:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f8ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051175:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f8b3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051183:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f8b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051190:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f8b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051290:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051299:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051307:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120969.051358:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789120969.051364:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789120969.051394:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051409:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051431:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f8ac lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051438:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f8ac lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051446:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f8ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051452:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120969.051457:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f8ac lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051464:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f8ac lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051480:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:2.0:1789120969.051483:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120969.051489:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f8ac lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051496:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f8ac lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051512:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f8b3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051518:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f8b3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051523:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f8b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051537:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120969.051540:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f8b3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051545:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f8b3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051553:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468852bf000) 00010000:00010000:2.0:1789120969.051555:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120969.051558:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f8b3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051564:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f8b3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051595:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f8a5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea72 expref: 47 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051610:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea72 expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.051617:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:2.0:1789120969.051620:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120969.051622:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0c00, rc 0) 00000100:00100000:2.0:1789120969.053349:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+46:11536:x1876028947479296:12345-192.168.202.32@tcp:101:stat.0 Request processed in 2686us (3583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120969.053364:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:0.0:1789120969.142437:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120969.144250:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947479552 00000100:00100000:1.0:1789120969.144270:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947479552 00000100:00100000:1.0:1789120969.144370:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:1.0:1789120969.144382:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+46:11546:x1876028947479552:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789120969.144519:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120969.144551:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f8c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea79 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120969.144683:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789120969.145126:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f8c1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea79 expref: 48 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.145212:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:1.0:1789120969.145216:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120969.145241:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f8c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea79 expref: 48 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.145259:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3000, rc 0) 00000100:00100000:1.0:1789120969.145354:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+47:11546:x1876028947479552:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 973us (2932us total) trans 4294967341 rc 301/301 00000100:00100000:1.0:1789120969.145363:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:0.0:1789120969.148694:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120969.148790:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947479808 00000100:00100000:2.0:1789120969.149154:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947479808 00000100:00100000:2.0:1789120969.149232:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:2.0:1789120969.149244:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+47:11546:x1876028947479808:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789120969.150975:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+48:11546:x1876028947479808:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 1723us (2281us total) trans 4294967342 rc 0/0 00000100:00100000:2.0:1789120969.150986:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:3.0:1789120969.223963:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120969.224184:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947480064 00000100:00100000:1.0:1789120969.224198:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947480064 00000100:00100000:1.0:1789120969.224284:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:1.0:1789120969.224297:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891483c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+48:11552:x1876028947480064:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789120969.224332:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120969.224362:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f8cf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea80 expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.224515:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.224534:0:9342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea72 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.224544:0:9342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.224587:0:9342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea72 expref: 49 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.224603:0:9342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea72 expref: 49 pid: 6519 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120969.224647:0:9342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970645376:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789120969.224795:0:9342:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120969.229498:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120969.229636:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947480192 00000100:00100000:2.0:1789120969.229648:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947480192 00010000:00010000:2.0:1789120969.229706:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea72 expref: 50 pid: 6519 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120969.229762:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:2.0:1789120969.229775:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+50:2412:x1876028947480192:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120969.229795:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120969.229804:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea72 expref: 50 pid: 6519 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120969.230024:0:9342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970645376:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120969.230053:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea72 expref: 50 pid: 6519 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.231777:0:9342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.231811:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8ba lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea72 expref: 50 pid: 6519 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.232056:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:2.0:1789120969.232064:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.232107:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.232116:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.232284:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120969.232383:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f70c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+49:2412:x1876028947480192:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 2608us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120969.232395:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00010000:00010000:1.0:1789120969.233095:0:9342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.233106:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120969.233134:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789120969.233327:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f8cf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea80 expref: 50 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.233352:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea80 expref: 49 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.233362:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120969.233365:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789120969.233369:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3400, rc 0) 00000100:00100000:1.0:1789120969.233548:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891483c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+49:11552:x1876028947480064:12345-192.168.202.32@tcp:101:bash.0 Request processed in 9254us (9600us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789120969.233557:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:0.0:1789120969.239204:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120969.242525:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947480448 00000100:00100000:2.0:1789120969.242550:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947480448 00000100:00100000:2.0:1789120969.242647:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:2.0:1789120969.242660:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+49:11552:x1876028947480448:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:2.0:1789120969.243201:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.243223:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.243238:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120969.243296:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:2.0:1789120969.243324:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000034ebec18 reply state 00000000e4321a27 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.243339:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.243368:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:2.0:1789120969.243371:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789120969.243376:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120969.243647:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+52:11552:x1876028947480448:12345-192.168.202.32@tcp:36:bash.0 Request processed in 987us (4455us total) trans 4294967345 rc 0/0 00000100:00100000:2.0:1789120969.243657:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00000020:00080000:2.0:1789120969.243664:0:6519:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789120969.250462:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120969.250718:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947480576 00000100:00100000:1.0:1789120969.250750:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947480576 00000100:00100000:1.0:1789120969.250939:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:1.0:1789120969.250968:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+52:11552:x1876028947480576:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789120969.251012:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120969.251047:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f8eb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea87 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.251283:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f8f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.251304:0:11088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea80 expref: 53 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.251315:0:11088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f8f2 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.251359:0:11088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea80 expref: 53 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.251374:0:11088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea80 expref: 53 pid: 9342 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120969.251667:0:11088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970645504:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789120969.252075:0:11088:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030540 going to sleep for 11 seconds 00000100:00100000:1.0:1789120969.254852:0:11088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970645504:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120969.254893:0:11088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f8f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120969.255513:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120969.255937:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947480704 00000100:00100000:1.0:1789120969.255965:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947480704 00010000:00010000:1.0:1789120969.256027:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea80 expref: 54 pid: 9342 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120969.256077:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:1.0:1789120969.256089:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:2411:x1876028947480704:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120969.256108:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120969.256115:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea80 expref: 54 pid: 9342 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.256129:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea80 expref: 54 pid: 9342 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.256168:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8d6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea80 expref: 54 pid: 9342 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.256188:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120969.256194:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f8f2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.256205:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.256213:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f8f2 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.256251:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120969.256329:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f4f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+53:2411:x1876028947480704:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 241us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120969.256350:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 70 00010000:00010000:3.0:1789120969.256491:0:11088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.256500:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120969.256569:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789120969.256575:0:11088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120969.256604:0:11088:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.256642:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f8eb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea87 expref: 53 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.256658:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea87 expref: 52 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.256666:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:3.0:1789120969.256669:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120969.256672:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2c00, rc 0) 00000100:00100000:3.0:1789120969.256706:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+52:11552:x1876028947480576:12345-192.168.202.32@tcp:101:bash.0 Request processed in 5743us (6579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120969.256714:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:0.0:1789120969.261486:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120969.261959:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947480960 00000100:00100000:3.0:1789120969.261972:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947480960 00000100:00100000:3.0:1789120969.262154:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:3.0:1789120969.262169:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+52:11552:x1876028947480960:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:3.0:1789120969.262814:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913ffc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+53:11552:x1876028947480960:12345-192.168.202.32@tcp:35:bash.0 Request processed in 644us (1348us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789120969.262863:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:0.0:1789120969.377219:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120969.377379:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947481216 00000100:00100000:1.0:1789120969.377394:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947481216 00000100:00100000:1.0:1789120969.377485:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:1.0:1789120969.377499:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+53:11562:x1876028947481216:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789120969.377535:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120969.377565:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea8e expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120969.377702:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:1.0:1789120969.377887:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8f9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea8e expref: 55 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.377917:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:1.0:1789120969.377921:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120969.377928:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830f8f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea8e expref: 55 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.377945:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3400, rc 0) 00000100:00100000:1.0:1789120969.378036:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:11562:x1876028947481216:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 540us (832us total) trans 4294967347 rc 301/301 00000100:00100000:1.0:1789120969.378045:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:0.0:1789120969.386989:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120969.387584:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947481344 00000100:00100000:2.0:1789120969.387597:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947481344 00000100:00100000:2.0:1789120969.387688:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:2.0:1789120969.387700:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:11562:x1876028947481344:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:2.0:1789120969.387806:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f907 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.387877:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f907 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.387893:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f907 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.387917:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f90e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.387926:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f90e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.387934:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f90e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388038:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f915 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388067:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f915 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388075:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f915 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120969.388408:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f915 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388427:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f907 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388434:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f907 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388441:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f907 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388449:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120969.388455:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f907 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388464:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f907 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388487:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:2.0:1789120969.388491:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120969.388497:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f907 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388503:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f907 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388529:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f90e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388536:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f90e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388542:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f90e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388548:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120969.388551:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f90e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388557:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f90e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388565:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468852bf000) 00010000:00010000:2.0:1789120969.388568:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120969.388571:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f90e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388578:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f90e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388588:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f915 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388594:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f915 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388599:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f915 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388610:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120969.388614:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f915 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388619:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f915 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388629:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:2.0:1789120969.388631:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120969.388634:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f915 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.388640:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f915 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120969.388770:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f6d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:11562:x1876028947481344:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 1067us (1791us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120969.388782:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:0.0:1789120969.392532:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120969.393374:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947481600 00000100:00100000:2.0:1789120969.393391:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947481600 00000100:00100000:2.0:1789120969.393484:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:2.0:1789120969.393497:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:11562:x1876028947481600:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789120969.393811:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+55:11562:x1876028947481600:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 315us (1294us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789120969.393846:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00010000:00010000:0.0:1789120969.430594:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120969.461216:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120969.461388:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947481856 00000100:00100000:3.0:1789120969.461401:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947481856 00000100:00100000:3.0:1789120969.461546:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:3.0:1789120969.461559:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+55:11565:x1876028947481856:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120969.461595:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120969.461624:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f91c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea95 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.461742:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f923 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.461762:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f923 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.461777:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f923 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.461789:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f92a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.461797:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f92a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.461803:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f92a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462030:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f931 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462059:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462067:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f931 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120969.462081:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789120969.462200:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f923 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462208:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f923 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462216:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f923 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462223:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120969.462228:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f923 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462237:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f923 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462253:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120969.462257:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120969.462263:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f923 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462270:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f923 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462287:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f92a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462299:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f92a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462305:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f92a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462311:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217cc00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120969.462314:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f92a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462320:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f92a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462329:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468852bf000) 00010000:00010000:3.0:1789120969.462332:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120969.462335:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f92a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462342:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f92a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462394:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830f91c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea95 expref: 58 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462411:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f931 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea95 expref: 57 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.462419:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:3.0:1789120969.462421:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120969.462431:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d200, rc 0) 00000100:00100000:3.0:1789120969.462509:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+57:11565:x1876028947481856:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 951us (1308us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1789120969.462518:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:0.0:1789120969.469627:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120969.469804:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947481984 00000100:00100000:3.0:1789120969.469817:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947481984 00000100:00100000:3.0:1789120969.469959:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:3.0:1789120969.469972:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+57:2411:x1876028947481984:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120969.470005:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120969.470040:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f931 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea95 expref: 57 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.470066:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:3.0:1789120969.470072:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120969.470158:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835e8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+56:2411:x1876028947481984:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 188us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120969.470167:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:0.0:1789120969.474445:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120969.474632:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947482112 00000100:00100000:3.0:1789120969.474645:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947482112 00000100:00100000:3.0:1789120969.474727:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 73 00000100:00100000:3.0:1789120969.474739:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+56:11565:x1876028947482112:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:3.0:1789120969.474887:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830f93f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.474920:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830f93f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.474936:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830f93f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.475017:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830f93f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.475025:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830f93f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.475033:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830f93f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.475040:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120969.475045:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830f93f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.475054:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830f93f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.475069:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:3.0:1789120969.475072:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120969.475078:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830f93f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.475085:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830f93f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120969.477342:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+56:11565:x1876028947482112:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 2587us (2893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120969.477368:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 73 00000100:00100000:0.0:1789120969.481439:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120969.481665:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947482368 00000100:00100000:1.0:1789120969.481678:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947482368 00000100:00100000:1.0:1789120969.481758:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:1.0:1789120969.481770:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+56:11565:x1876028947482368:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:1.0:1789120969.482550:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+57:11565:x1876028947482368:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 777us (1122us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789120969.482560:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:0.0:1789120969.709304:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120969.710319:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947482624 00000100:00100000:2.0:1789120969.710335:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947482624 00000100:00100000:2.0:1789120969.710634:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 74 00000100:00100000:2.0:1789120969.710647:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+57:11583:x1876028947482624:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:2.0:1789120969.710684:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120969.710715:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f946 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ea9c expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.710919:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f94d lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.710938:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f94d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.710953:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f94d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120969.710967:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789120969.711134:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f946 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea9c expref: 60 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.711156:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f94d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea9c expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.711167:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:2.0:1789120969.711170:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789120969.711174:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1200, rc 0) 00000100:00100000:2.0:1789120969.711276:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+59:11583:x1876028947482624:12345-192.168.202.32@tcp:101:cat.0 Request processed in 630us (1997us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1789120969.711305:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 74 00000001:00080000:0.0:1789120969.722867:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:0.0:1789120969.722964:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1789120969.723006:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9468852cb600 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1789120969.723013:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94688a487800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9468852cb480 00000020:00080000:0.0:1789120969.723017:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94688a487700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9468a3ac6a00 00000100:00100000:2.0:1789120969.723160:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:3.0:1789120969.723170:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:2.0:1789120969.723193:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970645632:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789120969.723379:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789120969.723439:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789120969.723465:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970645632 00000100:00100000:3.0:1789120969.723474:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970645632 00000100:00080000:2.0:1789120969.723516:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789120969.723575:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789120969.723588:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970645632:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789120969.723634:0:8433:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:3.0:1789120969.723679:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 13, mtime: 0x6aa3d1c6, atime: 0x6aa3d1c7, ctime: 0x6aa3d1c6, blocks: 0x8 00010000:00010000:3.0:1789120969.723689:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037ba3b06/0xb74d2367a830f95b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.723710:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=419s v=(0 0) 00010000:00010000:3.0:1789120969.723716:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120969.723723:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037ba3b06/0xb74d2367a830f95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.723744:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037ba3b06/0xb74d2367a830f95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.723755:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037ba3b06/0xb74d2367a830f95b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.723765:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037ba3b06/0xb74d2367a830f95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.723795:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789120969.723927:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120969.723936:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037ba3b06/0xb74d2367a830f95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120969.723947:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789120969.723959:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037ba3b06/0xb74d2367a830f95b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120969.723969:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e58f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3647:x1876028970645632:12345-0@lo:6:osp-syn-1-0.0 Request processed in 382us (589us total) trans 4294967302 rc 0/0 00010000:00010000:0.0:1789120969.723973:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037ba3b06/0xb74d2367a830f95b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120969.723983:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789120969.724009:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037ba3b06/0xb74d2367a830f95b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120969.724019:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037ba3b06/0xb74d2367a830f95b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120969.724044:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120969.724046:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120969.724048:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789120969.724053:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9468914f2580/2, rc 0, transno 4294967302 00000100:00100000:3.0:1789120969.724060:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970645632:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1789120969.725279:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725296:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725304:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725309:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120969.725314:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725322:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725341:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9468c1bfa900) 00010000:00010000:1.0:1789120969.725345:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120969.725351:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725358:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a830f72b lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725381:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725388:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725412:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725431:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120969.725434:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725440:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725449:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:1.0:1789120969.725451:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120969.725454:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725460:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830f732 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725479:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725486:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725492:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725496:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120969.725500:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725516:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725525:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468852bf000) 00010000:00010000:1.0:1789120969.725527:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120969.725531:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725537:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830f771 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725556:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725563:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725568:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725573:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120969.725576:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725582:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725590:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120969.725593:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120969.725596:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725613:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830f87b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725627:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725633:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725639:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725644:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120969.725647:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725654:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725662:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120969.725665:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120969.725668:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725674:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830f89e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725685:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725692:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725704:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725710:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120969.725713:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725720:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725729:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120969.725731:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120969.725734:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120969.725740:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f8e4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120969.745484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120969.745585:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947482752 00000100:00100000:3.0:1789120969.745613:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947482752 00000100:00100000:3.0:1789120969.745678:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 75 00000100:00100000:3.0:1789120969.745687:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:11584:x1876028947482752:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120969.745725:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120969.745748:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f962 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eaa3 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.746003:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f969 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.746022:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.746035:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120969.746094:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789120969.746098:0:11088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120969.746122:0:11088:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f969 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.746155:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f962 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaa3 expref: 15 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.746178:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f969 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaa3 expref: 14 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120969.746187:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120969.746190:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120969.746194:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217cc00, rc 0) 00000100:00100000:3.0:1789120969.746905:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11584:x1876028947482752:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1212us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120969.746917:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 75 00000100:00100000:3.0:1789120969.754216:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120969.757230:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947483136 00000100:00100000:0.0:1789120969.757316:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947483136 00000100:00100000:2.0:1789120969.757941:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:2.0:1789120969.757956:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11584:x1876028947483136:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789120969.758367:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:11584:x1876028947483136:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 412us (4164us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1789120969.758377:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:0.0:1789120969.762761:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120969.762866:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947483264 00000100:00100000:2.0:1789120969.762880:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947483264 00000100:00100000:2.0:1789120969.763057:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:2.0:1789120969.763069:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:11584:x1876028947483264:12345-192.168.202.32@tcp:103:lfs.0 00010000:00010000:2.0:1789120969.763090:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789120969.763121:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f8f2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea87 expref: 15 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.763218:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f94d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea9c expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.763235:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830f7ef lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea41 expref: 13 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.763248:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:2.0:1789120969.763273:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120969.763345:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f43c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:11584:x1876028947483264:12345-192.168.202.32@tcp:103:lfs.0 Request processed in 277us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120969.763353:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:0.0:1789120969.766374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120969.768311:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947483392 00000100:00100000:2.0:1789120969.768329:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947483392 00000100:00100000:2.0:1789120969.768449:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 76 00000100:00100000:2.0:1789120969.768462:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:11584:x1876028947483392:12345-192.168.202.32@tcp:58:lfs.0 00010000:00010000:2.0:1789120969.768632:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f970 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.768656:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f970 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.768672:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f970 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120969.769059:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789120969.769256:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789120969.769354:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789120969.769480:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:11584:x1876028947483392:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 1016us (3117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120969.769491:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 76 00000100:00100000:3.0:1789120969.802005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120969.803321:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947483520 00000100:00100000:2.0:1789120969.803337:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947483520 00000100:00100000:2.0:1789120969.803515:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:2.0:1789120969.803529:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:11586:x1876028947483520:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789120969.803558:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120969.803609:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f977 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eaaa expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.803721:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f97e lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.803739:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f97e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.803752:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f97e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.803768:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f985 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.803774:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f985 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.803780:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f985 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.803922:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.803930:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.803937:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120969.803988:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789120969.804005:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789120969.804027:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804050:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804059:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f97e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804066:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f97e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804073:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f97e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804078:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120969.804082:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f97e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804090:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f97e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804102:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:2.0:1789120969.804105:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120969.804110:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f97e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804117:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830f97e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804131:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f985 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804137:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f985 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804148:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f985 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804153:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120969.804156:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f985 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804163:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f985 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804171:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468c0868700) 00010000:00010000:2.0:1789120969.804173:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120969.804176:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f985 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804181:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830f985 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804215:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830f977 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaaa expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804227:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaaa expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120969.804234:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:2.0:1789120969.804237:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789120969.804239:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0c00, rc 0) 00000100:00100000:2.0:1789120969.804316:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891480b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:11586:x1876028947483520:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 790us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120969.804333:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:2.0:1789120970.132369:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970645760:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120970.132469:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120970.132516:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970645888:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789120970.132545:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970645760 00000100:00100000:2.0:1789120970.132551:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970645760 00000100:00100000:1.0:1789120970.132583:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120970.141235:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970645888 00000100:00100000:3.0:1789120970.141253:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970645888 00000100:00100000:3.0:1789120970.141306:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789120970.141318:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970645760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789120970.141356:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789120970.141447:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970645760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (8977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120970.141455:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789120970.141474:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1789120970.141481:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970645888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120970.141498:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789120970.141731:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970645760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789120970.142274:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970645888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 792us (9691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120970.142282:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789120970.144088:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970645888:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789120970.451209:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789120970.580464:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120970.580475:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120970.580523:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789120970.580532:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789120970.580691:0:14508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970646016:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789120970.580803:0:14508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120970.600154:0:14508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970646016:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789120970.600172:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120970.600530:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947483648 00000100:00100000:2.0:1789120970.600538:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947483648 00000100:00100000:2.0:1789120970.600624:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 78 00000100:00100000:2.0:1789120970.600634:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:11597:x1876028947483648:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789120970.600666:0:11088:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789120970.600767:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:11597:x1876028947483648:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 134us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120970.600774:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 78 00000100:00080000:3.0:1789120970.602621:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120970.610364:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.611341:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947483776 00000100:00100000:1.0:1789120970.611351:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947483776 00000100:00100000:1.0:1789120970.611482:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 79 00000100:00100000:1.0:1789120970.611497:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:11597:x1876028947483776:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789120970.611586:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f993 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611611:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f993 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611643:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f993 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611679:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f99a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611687:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f99a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611694:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f99a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611720:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611729:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611735:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120970.611782:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789120970.611787:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789120970.611799:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611845:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f993 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611854:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f993 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611870:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f993 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611877:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120970.611881:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f993 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611889:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f993 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611901:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:1.0:1789120970.611904:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120970.611909:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f993 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611914:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830f993 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611925:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f99a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611931:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f99a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611937:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f99a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611942:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120970.611945:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f99a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611962:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f99a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611970:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9468852bf000) 00010000:00010000:1.0:1789120970.611973:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120970.611976:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f99a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.611982:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f99a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.612009:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.612014:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.612019:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.612024:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120970.612027:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.612032:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.612039:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120970.612042:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120970.612045:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.612062:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120970.612669:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:11597:x1876028947483776:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 Request processed in 1163us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120970.612685:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 79 00000100:00100000:0.0:1789120970.624425:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.624501:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947484032 00000100:00100000:1.0:1789120970.624512:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947484032 00000100:00100000:1.0:1789120970.624572:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:1.0:1789120970.624583:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:11597:x1876028947484032:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120970.624604:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120970.624624:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eab1 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.624728:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.624745:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.624756:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120970.624768:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789120970.624895:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.624903:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.624928:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.624934:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120970.624938:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.624946:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.624957:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120970.624961:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789120970.624966:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9af lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.624972:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.625026:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eab1 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.625037:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:1.0:1789120970.625039:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120970.625043:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eab1 expref: 15 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.625053:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2600, rc 0) 00000100:00100000:1.0:1789120970.625124:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11597:x1876028947484032:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 542us (708us total) trans 4294967353 rc 301/301 00000100:00100000:1.0:1789120970.625141:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:2.0:1789120970.633082:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120970.633435:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947484160 00000100:00100000:0.0:1789120970.633444:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947484160 00000100:00100000:0.0:1789120970.633507:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 81 00000100:00100000:0.0:1789120970.633518:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11597:x1876028947484160:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789120970.633555:0:9342:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789120970.636181:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e58b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11597:x1876028947484160:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 2652us (3361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120970.636195:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 81 00000040:00080000:1.0:1789120970.642567:0:14921:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120970.642577:0:14921:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789120970.642603:0:14921:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789120970.642611:0:14921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789120970.649016:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.649089:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947484416 00000100:00100000:1.0:1789120970.649099:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947484416 00000100:00100000:1.0:1789120970.649161:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 82 00000100:00100000:1.0:1789120970.649172:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11597:x1876028947484416:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120970.649195:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120970.649198:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789120970.649225:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830f969 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaa3 expref: 14 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.649244:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:1.0:1789120970.649250:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120970.649263:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9bd lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eab8 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789120970.649678:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789120970.649816:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9c4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.650409:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.650423:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9c4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.650505:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830f9bd lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eab8 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.650522:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9c4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eab8 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.650531:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468852bf000) 00010000:00010000:1.0:1789120970.650534:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120970.650538:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3000, rc 0) 00000100:00100000:1.0:1789120970.650613:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:11597:x1876028947484416:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1443us (1604us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789120970.650623:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 82 00000100:00100000:2.0:1789120970.667706:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120970.667762:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947484672 00000100:00100000:3.0:1789120970.667772:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947484672 00000100:00100000:3.0:1789120970.667850:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 83 00000100:00100000:3.0:1789120970.667861:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:11597:x1876028947484672:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789120970.668052:0:11088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120970.668080:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830f9c4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eab8 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.668097:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468852bf000) 00010000:00010000:3.0:1789120970.668106:0:11088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120970.668129:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f9d2 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.668144:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f9d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.668156:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f9d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668227:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830f9d9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x21558a6c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668237:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830f9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x21558a6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668246:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830f9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x21558a6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668294:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f9d2 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668301:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f9d2 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668307:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f9d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668313:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120970.668316:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f9d2 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668323:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f9d2 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668332:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:0.0:1789120970.668335:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120970.668348:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f9d2 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668354:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830f9d2 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668365:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830f9d9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x21558a6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668371:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830f9d9 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21558a6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668376:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830f9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21558a6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668382:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120970.668385:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830f9d9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21558a6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668390:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830f9d9 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x21558a6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668398:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x21558a6c (ffff9468c1bd2900) 00010000:00010000:0.0:1789120970.668400:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120970.668403:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830f9d9 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x21558a6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.668408:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830f9d9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x21558a6c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120970.668500:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11597:x1876028947484672:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 639us (804us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120970.668517:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 83 00000100:00100000:1.0:1789120970.675330:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120970.675734:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947484800 00000100:00100000:0.0:1789120970.675744:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947484800 00000100:00100000:0.0:1789120970.675805:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:0.0:1789120970.675816:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11597:x1876028947484800:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120970.675902:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120970.675928:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9e0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eabf expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.675965:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f9e7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.675978:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.676001:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.676121:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9e0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eabf expref: 16 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.679088:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eabf expref: 15 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.679104:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:0.0:1789120970.679107:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789120970.679111:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23600, rc 0) 00000100:00100000:0.0:1789120970.679194:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:11597:x1876028947484800:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 3379us (3871us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120970.679209:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:0.0:1789120970.686142:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120970.687202:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947485056 00000100:00100000:3.0:1789120970.687212:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947485056 00000100:00100000:3.0:1789120970.687291:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:3.0:1789120970.687301:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:11597:x1876028947485056:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789120970.687480:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.687507:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.687548:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789120970.687775:0:6519:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1789120970.687787:0:6519:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 420876965545ns, next at 421876963622ns, rc = 0 00000004:00010000:3.0:1789120970.687919:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ded9d8ff reply state 00000000d73783ab transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.687939:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.687954:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:3.0:1789120970.687957:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789120970.687962:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789120970.692324:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:11597:x1876028947485056:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 5015us (6188us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789120970.692337:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:2.0:1789120970.711803:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120970.711943:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947485184 00000100:00100000:0.0:1789120970.711953:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947485184 00000100:00100000:0.0:1789120970.712014:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:0.0:1789120970.712025:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:11597:x1876028947485184:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120970.712057:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120970.712077:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9f5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eac6 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.712141:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eac6 expref: 18 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.712160:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eac6 expref: 18 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.712179:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:0.0:1789120970.712182:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789120970.712186:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23a00, rc 0) 00000100:00100000:0.0:1789120970.712266:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e5b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:11597:x1876028947485184:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 242us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120970.712274:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:3.0:1789120970.718165:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.718270:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947485312 00000100:00100000:1.0:1789120970.718280:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947485312 00000100:00100000:1.0:1789120970.718330:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:1.0:1789120970.718340:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2408:x1876028947485312:12345-192.168.202.32@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1789120970.718372:0:8435:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp t0 exp 0000000000000000 cur 420 last 0 00000020:00000080:1.0:1789120970.718410:0:8435:0:(genops.c:1385:class_connect()) connect: client 3dde8702-0a22-4cb8-87f3-66b167299fdd, cookie 0xb74d2367a830f9fc 00002000:00100000:1.0:1789120970.718422:0:8435:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3dde8702-0a22-4cb8-87f3-66b167299fdd/ffff9467849b3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789120970.718441:0:8435:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789120970.718541:0:8435:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789120970.718579:0:8435:0:(import.c:65:import_set_state_nolock()) ffff9467849b6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789120970.718661:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2408:x1876028947485312:12345-192.168.202.32@tcp:8:lhsmtool_posix.0 Request processed in 320us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120970.718682:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:2.0:1789120970.731264:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120970.731334:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947485440 00000100:00100000:3.0:1789120970.731352:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947485440 00000100:00100000:3.0:1789120970.731508:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:3.0:1789120970.731521:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:0:x1876028947485440:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00000001:00080000:0.0:1789120970.733647:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00100000:0.0:1789120970.733661:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000100:00080000:2.0:1789120970.734283:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120970.734537:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e592c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:0:x1876028947485440:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 3010us (3275us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789120970.734579:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:3.0:1789120970.741476:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.744645:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947485696 00000100:00100000:1.0:1789120970.744661:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947485696 00000100:00100000:1.0:1789120970.744734:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:1.0:1789120970.744745:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:11597:x1876028947485696:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789120970.745030:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:11597:x1876028947485696:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 287us (3563us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789120970.745039:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:3.0:1789120970.749005:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.749119:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947485952 00000100:00100000:1.0:1789120970.749128:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947485952 00000100:00100000:1.0:1789120970.749191:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 87 00000100:00100000:1.0:1789120970.749202:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:11597:x1876028947485952:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789120970.749321:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99b2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:11597:x1876028947485952:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 120us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120970.749329:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 87 00000100:00100000:1.0:1789120970.752997:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120970.753217:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947486080 00000100:00100000:3.0:1789120970.753231:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947486080 00000100:00100000:3.0:1789120970.753301:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 88 00000100:00100000:3.0:1789120970.753312:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:11597:x1876028947486080:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120970.753349:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120970.753375:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa03 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eacd expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.753466:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fa0a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.753486:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fa0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.753501:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fa0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120970.753546:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120970.753578:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fa0a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.753613:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa03 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eacd expref: 21 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.753636:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fa0a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eacd expref: 20 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.753649:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:3.0:1789120970.753651:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789120970.753656:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217c000, rc 0) 00000100:00100000:3.0:1789120970.753727:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:11597:x1876028947486080:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 417us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120970.753735:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 88 00000100:00100000:3.0:1789120970.761072:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120970.761216:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947486208 00000100:00100000:2.0:1789120970.761230:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947486208 00000100:00100000:2.0:1789120970.761295:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:2.0:1789120970.761306:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893846580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947486208:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120970.761333:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120970.761356:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000074fd36bb/0xb74d2367a830fa11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ead4 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120970.761383:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3d1ca, blocks: 0x0 00010000:00010000:2.0:1789120970.761400:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=420s v=(0 0) 00010000:00010000:2.0:1789120970.761405:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120970.761414:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000074fd36bb/0xb74d2367a830fa11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ead4 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120970.761434:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000074fd36bb/0xb74d2367a830fa11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ead4 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120970.761470:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0400, rc 0) 00000100:00100000:2.0:1789120970.761543:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893846580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947486208:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 238us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120970.761550:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:3.0:1789120970.765647:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120970.765741:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947486464 00000100:00100000:2.0:1789120970.765762:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947486464 00000100:00100000:2.0:1789120970.765956:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 89 00000100:00100000:2.0:1789120970.765971:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:11597:x1876028947486464:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789120970.766115:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b93840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:11597:x1876028947486464:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 147us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120970.766125:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 89 00000100:00100000:3.0:1789120970.769215:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120970.769271:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947486592 00000100:00100000:3.0:1789120970.769281:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947486592 00000100:00100000:3.0:1789120970.769358:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:3.0:1789120970.769370:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:11597:x1876028947486592:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120970.769395:0:9116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120970.769420:0:9116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eadb expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.769460:0:9116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000074fd36bb/0xb74d2367a830fa11 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ead4 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.769470:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120970.769476:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120970.769481:0:9116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 7 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.769524:0:9116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000074fd36bb/0xb74d2367a830fa11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ead4 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.769539:0:9116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000074fd36bb/0xb74d2367a830fa11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ead4 expref: 7 pid: 8435 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120970.769558:0:9116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9116:1876028970646144:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120970.769690:0:9116:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120970.773234:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.773280:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947486720 00000100:00100000:1.0:1789120970.773288:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947486720 00010000:00010000:1.0:1789120970.773339:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000074fd36bb/0xb74d2367a830fa11 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ead4 expref: 8 pid: 8435 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120970.773397:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:1.0:1789120970.773409:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947486720:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120970.773441:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120970.773477:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000074fd36bb/0xb74d2367a830fa11 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ead4 expref: 8 pid: 8435 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.773497:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000074fd36bb/0xb74d2367a830fa11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ead4 expref: 8 pid: 8435 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.773532:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120970.773537:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120970.773548:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 8 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.773571:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 8 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.773621:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 8 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120970.773635:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1876028970646272:192.168.202.32@tcp:105: 00000100:00100000:1.0:1789120970.773719:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3aa80 going to sleep for 11 seconds 00010000:00010000:1.0:1789120970.774159:0:9116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000074fd36bb/0xb74d2367a830fa11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ead4 expref: 8 pid: 8435 timeout: 520 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120970.774175:0:9116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9116:1876028970646144:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120970.774200:0:9116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 7 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.774222:0:9116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217de00, rc 0) 00000100:00100000:1.0:1789120970.774282:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:11597:x1876028947486592:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 4911us (5078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120970.774291:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:0.0:1789120970.787674:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1876028970646272:192.168.202.32@tcp:105: 00010000:00010000:0.0:1789120970.787710:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120970.787809:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947486720:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 14402us (14582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120970.787854:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:1.0:1789120970.789995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120970.793439:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947486848 00000100:00100000:0.0:1789120970.793452:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947486848 00002000:00100000:0.0:1789120970.793509:0:8440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9468b99c43c0 x1876028947486848/t0(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:501/0 lens 504/0 e 0 to 0 dl 1789120981 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120970.793520:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468b99c43c0 with x1876028947486848 ext(0->8) 00002000:00010000:0.0:1789120970.793525:0:8440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468b99c43c0 00000100:00100000:0.0:1789120970.793568:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:0.0:1789120970.793578:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947486848:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1789120970.799965:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c43c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2411:x1876028947486848:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 Request processed in 6376us (9978us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789120970.799995:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00002000:00100000:1.0:1789120970.800011:0:8440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9468b99c43c0 x1876028947486848/t4294967303(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:501/0 lens 504/448 e 0 to 0 dl 1789120981 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120970.800022:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468b99c43c0 with x1876028947486848 ext(0->8) 00002000:00010000:1.0:1789120970.800029:0:8440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468b99c43c0 00000100:00100000:1.0:1789120970.804659:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120970.804726:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947486976 00000100:00100000:3.0:1789120970.804743:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947486976 00000100:00100000:3.0:1789120970.805604:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 90 00000100:00100000:3.0:1789120970.805622:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:11597:x1876028947486976:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789120970.811663:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:0.0:1789120970.811689:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00010000:00010000:3.0:1789120970.811790:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.811806:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.811815:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.811859:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120970.811864:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.811874:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.811905:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:3.0:1789120970.811909:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789120970.811915:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.811923:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830f9ee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120970.812448:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970646400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789120970.812559:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789120970.812744:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1789120970.819613:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1789120970.819638:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789120970.821865:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11597:x1876028947486976:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 Request processed in 15667us (16632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120970.821945:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 90 00000100:00100000:3.0:1789120970.824772:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970646400 00000100:00100000:3.0:1789120970.824791:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970646400 00000100:00100000:3.0:1789120970.824921:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789120970.824934:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970646400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789120970.825136:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789120970.825141:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789120970 00002000:00010000:3.0:1789120970.825144:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789120970.825146:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789120970 -> 1789120970 00002000:00010000:3.0:1789120970.825149:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:3.0:1789120970.825240:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970646400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 308us (12680us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789120970.825249:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789120970.825282:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120970.827729:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120970.827794:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947487104 00000100:00100000:3.0:1789120970.827804:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947487104 00000100:00100000:3.0:1789120970.827891:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:3.0:1789120970.827903:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783eca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947487104:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1789120970.835384:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9468bf70e940/2, rc 0, transno 4294967304 00000100:00100000:3.0:1789120970.835408:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970646400:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789120970.835509:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:3.0:1789120970.835521:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1789120970.835724:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783eca1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947487104:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 Request processed in 7812us (8000us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120970.835739:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:1.0:1789120970.846584:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120970.846664:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947487360 00000100:00100000:0.0:1789120970.846684:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947487360 00000100:00100000:0.0:1789120970.846771:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 91 00000100:00100000:0.0:1789120970.846783:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11597:x1876028947487360:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789120970.846887:0:11088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120970.846916:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fa0a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eacd expref: 14 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.846939:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:0.0:1789120970.846944:0:11088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120970.846976:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.847076:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.847090:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789120970.847595:0:11088:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000007f8c2e46 reply state 000000008cf9c50b transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.847609:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.847617:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:0.0:1789120970.847620:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789120970.847622:0:11088:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789120970.847740:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:11597:x1876028947487360:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 958us (1170us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1789120970.847749:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 91 00000100:00100000:0.0:1789120970.853377:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120970.853866:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947487488 00000100:00100000:3.0:1789120970.853882:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947487488 00000100:00100000:3.0:1789120970.853971:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:3.0:1789120970.853997:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947487488:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789120970.854220:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789120970.854224:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789120970 -> 1789120968 00002000:00010000:3.0:1789120970.854227:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789120967 00002000:00010000:3.0:1789120970.854230:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789120970 -> 1789120968 00002000:00010000:3.0:1789120970.854233:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789120970.854483:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947487488:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 498us (1114us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789120970.854492:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:3.0:1789120970.859243:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120970.859402:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947487744 00000100:00100000:2.0:1789120970.859433:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947487744 00000100:00100000:2.0:1789120970.859507:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 92 00000100:00100000:2.0:1789120970.859520:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:11597:x1876028947487744:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789120970.859613:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120970.859634:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f9e7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eabf expref: 15 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120970.859646:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120970.859688:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eabf expref: 15 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120970.859704:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f9e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eabf expref: 15 pid: 9342 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120970.859720:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970646528:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120970.859876:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852cb600 going to sleep for 11 seconds 00000100:00100000:0.0:1789120970.870693:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120970.870747:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970646528:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120970.870797:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120970.871142:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947487872 00000100:00100000:3.0:1789120970.871151:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947487872 00010000:00010000:3.0:1789120970.871206:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f9e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eabf expref: 16 pid: 9342 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120970.871258:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:3.0:1789120970.871269:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:2412:x1876028947487872:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120970.871298:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120970.871307:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f9e7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eabf expref: 16 pid: 9342 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.871344:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eabf expref: 16 pid: 9342 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.871374:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830f9e7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eabf expref: 16 pid: 9342 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.871392:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:3.0:1789120970.871398:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.871410:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.871419:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.871456:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120970.871530:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:2412:x1876028947487872:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 262us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120970.871539:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 72 00010000:00010000:1.0:1789120970.871943:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.871954:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.872014:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.872021:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.872044:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.872051:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120970.872057:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.872066:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.872077:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:1.0:1789120970.872080:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789120970.872084:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.872092:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa26 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120970.872158:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11597:x1876028947487744:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 Request processed in 12639us (12926us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789120970.872169:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 92 00000100:00100000:0.0:1789120970.878239:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120970.878561:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947488000 00000100:00100000:3.0:1789120970.878575:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947488000 00000100:00100000:3.0:1789120970.878654:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:3.0:1789120970.878666:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2409:x1876028947488000:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789120970.878732:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.878785:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 7 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.878795:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789120970.878800:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120970.878805:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.878907:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 7 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.878926:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 7 pid: 9116 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120970.878945:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876028970646656:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120970.879086:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d240 going to sleep for 11 seconds 00000100:00100000:0.0:1789120970.881717:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec8b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876028970646656:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120970.881762:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120970.883492:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.885251:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947488128 00000100:00100000:1.0:1789120970.885269:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947488128 00010000:00010000:1.0:1789120970.885403:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 8 pid: 9116 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120970.885516:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 73 00000100:00100000:1.0:1789120970.885528:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2411:x1876028947488128:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120970.885568:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120970.885597:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 8 pid: 9116 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.885613:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 8 pid: 9116 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.885644:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095039edf/0xb74d2367a830fa18 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eadb expref: 8 pid: 9116 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.885666:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120970.885671:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120970.885677:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.885690:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.885728:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120970.885844:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7012c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947488128:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 318us (2365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120970.885853:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 73 00010000:00010000:0.0:1789120970.885935:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.885946:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.885973:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.885991:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.886000:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.886008:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789120970.886012:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.886023:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.886056:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.886064:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a830fa2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120970.886124:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7021c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2409:x1876028947488000:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 Request processed in 7459us (7899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120970.886139:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:0.0:1789120970.889070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120970.889153:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947488384 00000100:00100000:3.0:1789120970.889165:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947488384 00000100:00100000:3.0:1789120970.889443:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 93 00000100:00100000:3.0:1789120970.889456:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11597:x1876028947488384:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789120970.889571:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.889590:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f874 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea64 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.889621:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.889665:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f874 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea64 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.889681:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f874 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea64 expref: 14 pid: 6518 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120970.889699:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1876028970646784:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120970.890308:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468ab99d240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120970.908439:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.908546:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec8b40 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1876028970646784:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120970.908588:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120970.908872:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947488512 00000100:00100000:0.0:1789120970.908883:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947488512 00010000:00010000:0.0:1789120970.908932:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f874 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea64 expref: 15 pid: 6518 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120970.908972:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 74 00000100:00100000:0.0:1789120970.908994:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:2412:x1876028947488512:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120970.909010:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120970.909016:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f874 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea64 expref: 15 pid: 6518 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.909027:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f874 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea64 expref: 15 pid: 6518 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.909050:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830f874 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea64 expref: 15 pid: 6518 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.909084:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:0.0:1789120970.909090:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.909099:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.909107:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.909145:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120970.909188:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120970.909205:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:2412:x1876028947488512:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 222us (775us total) trans 0 rc 0/0 00010000:00010000:1.0:1789120970.909230:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120970.909232:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 74 00010000:00010000:1.0:1789120970.909615:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.909635:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9f5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eac6 expref: 14 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.909646:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.912469:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9f5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eac6 expref: 14 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.912500:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eac6 expref: 14 pid: 11088 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120970.912521:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1876028970646912:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120970.912936:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3a540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120970.919302:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.919417:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947488640 00000100:00100000:1.0:1789120970.919425:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947488640 00010000:00010000:1.0:1789120970.919469:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9f5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eac6 expref: 15 pid: 11088 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120970.919508:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 75 00000100:00100000:1.0:1789120970.919518:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:2411:x1876028947488640:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120970.919533:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120970.919555:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9f5 lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eac6 expref: 15 pid: 11088 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.919567:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9f5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eac6 expref: 15 pid: 11088 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.919592:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:1.0:1789120970.919605:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.919614:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.919621:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.919642:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120970.919707:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:2411:x1876028947488640:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 190us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120970.919717:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 75 00010000:00010000:0.0:1789120970.920626:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830f9f5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eac6 expref: 14 pid: 11088 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120970.920645:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f6fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1876028970646912:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120970.920665:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.920674:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.920680:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120970.920786:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:0.0:1789120970.920924:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:0.0:1789120970.920958:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1789120970.921056:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1876028970647040:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789120970.921110:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120970.921334:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688357b000 going to sleep for 11 seconds 00000100:00100000:1.0:1789120970.923108:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970647040 00000100:00100000:1.0:1789120970.923119:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970647040 00000100:00100000:1.0:1789120970.923320:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789120970.923331:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1876028970647040:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789120970.923462:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6518:x1876028970647040:12345-0@lo:1000:mdt00_000.0 Request processed in 133us (2351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120970.923470:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789120970.923538:0:6518:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789120970.923544:0:6518:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9468bf70e940, transno 4294967304 00000100:00100000:0.0:1789120970.923568:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1876028970647040:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1789120970.923713:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:0.0:1789120970.923782:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf64d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1876028970647168:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789120970.923846:0:6518:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120970.927387:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120970.931354:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970647168 00000100:00100000:3.0:1789120970.931369:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970647168 00000100:00100000:3.0:1789120970.931445:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789120970.931456:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6518:x1876028970647168:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789120970.931674:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6518:x1876028970647168:12345-0@lo:1000:mdt00_000.0 Request processed in 220us (7852us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1789120970.931682:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789120970.932041:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf64d680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6518:1876028970647168:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1789120970.932089:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932099:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932107:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932112:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120970.932117:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932125:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932140:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:0.0:1789120970.932155:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789120970.932161:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932167:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a830fa3b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932197:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f970 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932203:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f970 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932209:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f970 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932213:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120970.932216:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f970 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932222:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f970 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932228:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:0.0:1789120970.932230:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789120970.932233:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f970 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932238:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830f970 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932280:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932303:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaaa expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932313:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932343:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaaa expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120970.932356:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaaa expref: 17 pid: 6519 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120970.932370:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1876028970647296:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120970.932444:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789120970.943007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.943132:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947488768 00000100:00100000:1.0:1789120970.943143:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947488768 00010000:00010000:1.0:1789120970.943183:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaaa expref: 18 pid: 6519 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120970.943247:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 76 00000100:00100000:1.0:1789120970.943256:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:2412:x1876028947488768:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120970.943271:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120970.943277:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaaa expref: 18 pid: 6519 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.943289:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaaa expref: 18 pid: 6519 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.943312:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:1.0:1789120970.943317:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.943326:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.943334:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.943354:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120970.943412:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:2412:x1876028947488768:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 157us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120970.943420:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 76 00010000:00010000:3.0:1789120970.943586:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830f98c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaaa expref: 17 pid: 6519 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120970.943614:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5e940 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1876028970647296:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120970.943647:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.943658:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.943680:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945634:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945656:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945666:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945673:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120970.945679:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945702:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945726:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:3.0:1789120970.945730:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120970.945736:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945744:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fa42 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945764:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945771:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945798:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945804:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120970.945808:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945815:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945852:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468886f6800) 00010000:00010000:3.0:1789120970.945866:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789120970.945870:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120970.945877:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa34 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120970.946183:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:11597:x1876028947488384:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 56724us (57121us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1789120970.946197:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 93 00000020:00080000:3.0:1789120970.946205:0:6518:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789120970.946588:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120970.946594:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789120970.946613:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789120970.946622:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789120970.951404:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120970.951540:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947489024 00000100:00100000:1.0:1789120970.951550:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947489024 00000100:00100000:1.0:1789120970.951614:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:1.0:1789120970.951626:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:11597:x1876028947489024:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789120970.951925:0:6521:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789120970.951958:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:1.0:1789120970.952004:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830fa49 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.952030:0:6521:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830fa49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.952042:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830fa49 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.952050:0:6521:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830fa49 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.952055:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830fa49 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.952061:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830fa49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120970.952077:0:6521:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120970.952261:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120970.952269:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830fa49 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120970.952275:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789120970.952279:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830fa49 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120970.952286:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830fa49 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120970.952300:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:2.0:1789120970.952303:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789120970.952308:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830fa49 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120970.952315:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830fa49 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120970.952327:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120970.952329:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120970.952331:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120970.952387:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:11597:x1876028947489024:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 763us (991us total) trans 4294967364 rc 0/0 00000100:00100000:1.0:1789120970.952396:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000020:00080000:1.0:1789120970.952401:0:6521:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789120971.474049:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120972.187443:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970647808:0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.187540:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120972.187612:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970648320:0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.187644:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120972.187670:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970648832:0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.187723:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120972.187761:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789120972.187768:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970647680:0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.187797:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120972.187816:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970648192:0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.187865:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120972.189032:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970648704:0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.189098:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120972.193409:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970647808 00000100:00100000:3.0:1789120972.193427:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970647808 00000100:00100000:3.0:1789120972.193514:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970648192 00000100:00100000:3.0:1789120972.193518:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970648192 00000100:00100000:3.0:1789120972.193548:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970648704 00000100:00100000:3.0:1789120972.193552:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970648704 00000100:00100000:3.0:1789120972.193574:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789120972.193584:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970647808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.193687:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784897480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970647808:12345-0@lo:400:kworker.0 Request processed in 103us (6147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120972.193696:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1789120972.193722:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789120972.193729:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970648192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.193763:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784895680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970648192:12345-0@lo:400:kworker.0 Request processed in 34us (5897us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120972.193769:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1789120972.193781:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789120972.193788:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970648704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.193817:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebe580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970648704:12345-0@lo:400:kworker.0 Request processed in 31us (4720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120972.193867:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:3.0:1789120972.193966:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970648320 00000100:00100000:3.0:1789120972.193982:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970648320 00000100:00100000:3.0:1789120972.194020:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970648832 00000100:00100000:3.0:1789120972.194024:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970648832 00000100:00100000:3.0:1789120972.194048:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789120972.194055:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970648320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.194098:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784894f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970648320:12345-0@lo:400:kworker.0 Request processed in 44us (6453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120972.194105:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789120972.194478:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789120972.194491:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784896580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970648832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.194536:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784896580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970648832:12345-0@lo:400:kworker.0 Request processed in 50us (6813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120972.194542:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789120972.194570:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970647680 00000100:00100000:3.0:1789120972.194574:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970647680 00000100:00100000:3.0:1789120972.194605:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1789120972.194610:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970647680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.194642:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848970c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970647680:12345-0@lo:400:kworker.0 Request processed in 33us (6845us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120972.194647:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:3.0:1789120972.194675:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789120972.194680:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789120972.194683:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789120972.194725:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d19a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970647680:0@lo:400:kworker.0 00010000:00080000:3.0:1789120972.194741:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783f9c780 x1876028970648192/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120972.194763:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970648192:0@lo:400:kworker.0 00010000:00080000:3.0:1789120972.194775:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784891a40 x1876028970648704/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120972.194783:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970648704:0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.194796:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970647808:0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.194806:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970648320:0@lo:400:kworker.0 00000100:00100000:3.0:1789120972.194816:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970648832:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195029:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970647424:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195106:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120972.195160:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970647936:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195192:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120972.195215:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970648448:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195241:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120972.195258:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970648960:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195299:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120972.195324:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1789120972.195331:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970647552:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195356:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120972.195374:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970648064:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195394:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120972.195411:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970648576:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195434:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120972.195478:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970647424 00000100:00100000:2.0:1789120972.195483:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970647424 00000100:00100000:2.0:1789120972.195522:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1789120972.195531:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970647424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195573:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970647424:12345-0@lo:400:kworker.0 Request processed in 43us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.195581:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00000100:00100000:2.0:1789120972.195615:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970647936 00000100:00100000:2.0:1789120972.195619:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970647936 00000100:00100000:2.0:1789120972.195645:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789120972.195651:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970647936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195683:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970647936:12345-0@lo:400:kworker.0 Request processed in 33us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.195690:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789120972.195706:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970648448 00000100:00100000:2.0:1789120972.195710:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970648448 00000100:00100000:2.0:1789120972.195738:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970648960 00000100:00100000:2.0:1789120972.195741:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970648960 00000100:00100000:2.0:1789120972.195756:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789120972.195771:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876028970648448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195805:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1876028970648448:12345-0@lo:400:kworker.0 Request processed in 35us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.195812:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789120972.195855:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789120972.195862:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876028970648960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.195908:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876028970648960:12345-0@lo:400:kworker.0 Request processed in 46us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.195914:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789120972.195937:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970647552 00000100:00100000:2.0:1789120972.195941:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970647552 00000100:00100000:2.0:1789120972.195979:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970648064 00000100:00100000:2.0:1789120972.195982:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970648064 00000100:00100000:2.0:1789120972.196006:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970648576 00000100:00100000:2.0:1789120972.196009:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970648576 00000100:00100000:2.0:1789120972.196024:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789120972.196031:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970647552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.196064:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970647552:12345-0@lo:400:kworker.0 Request processed in 33us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.196070:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1789120972.196082:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789120972.196088:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970648064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.196115:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970648064:12345-0@lo:400:kworker.0 Request processed in 27us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.196122:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:2.0:1789120972.196133:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789120972.196138:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970648576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.196173:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970648576:12345-0@lo:400:kworker.0 Request processed in 35us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.196181:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1789120972.196240:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970647552:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.196253:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970648064:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.196264:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970648576:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.196274:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970647424:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.196285:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970647936:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.196298:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970648448:0@lo:400:kworker.0 00000100:00100000:2.0:1789120972.196310:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970648960:0@lo:400:kworker.0 00000100:00080000:2.0:1789120972.196358:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120972.196363:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120972.196365:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120972.198509:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970649088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120972.198602:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120972.198663:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120972.198672:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970649216:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789120972.198703:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120972.198736:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970649088 00000100:00100000:2.0:1789120972.198744:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970649088 00000100:00100000:2.0:1789120972.198792:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970649216 00000100:00100000:2.0:1789120972.198796:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970649216 00000100:00100000:2.0:1789120972.198813:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789120972.198850:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970649088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120972.200016:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789120972.201283:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789120972.201306:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970649216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120972.201494:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789120972.201689:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b05e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970649216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 392us (2983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120972.201697:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789120972.201756:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970649344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120972.202289:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120972.202355:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970649216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120972.203965:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970649344 00000100:00100000:3.0:1789120972.203986:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970649344 00000100:00100000:3.0:1789120972.204039:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789120972.204047:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876028970649344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120972.204074:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120972.204339:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876028970649344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 291us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120972.204405:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789120972.204458:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ebcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970649344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120972.219309:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970649088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 20444us (20691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.219331:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789120972.219517:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970649088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120972.237990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120972.238045:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120972.238071:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120972.238093:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120972.238115:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120972.238141:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120972.238166:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120972.238303:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947489408 00000100:00100000:2.0:1789120972.238314:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947489408 00000100:00100000:2.0:1789120972.238403:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947489920 00000100:00100000:2.0:1789120972.238407:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947489920 00000100:00100000:2.0:1789120972.238422:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947489280 00000100:00100000:2.0:1789120972.238424:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947489280 00000100:00100000:2.0:1789120972.238438:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947489792 00000100:00100000:2.0:1789120972.238440:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947489792 00000100:00100000:2.0:1789120972.238459:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 334 00000100:00100000:2.0:1789120972.238471:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784892580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947489408:12345-192.168.202.32@tcp:400:kworker.0 00000100:00080000:3.0:1789120972.238489:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789120972.238496:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789120972.238582:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784892580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947489408:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 112us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.238592:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 334 00000100:00100000:2.0:1789120972.238616:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 335 00000100:00100000:2.0:1789120972.238624:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947489920:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120972.238653:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947489920:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.238660:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 335 00000100:00100000:2.0:1789120972.238672:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 336 00000100:00100000:2.0:1789120972.238677:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:2410:x1876028947489280:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120972.238711:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ebcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:2410:x1876028947489280:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 33us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.238759:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 336 00000100:00100000:2.0:1789120972.238776:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 337 00000100:00100000:2.0:1789120972.238783:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947489792:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120972.238814:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947489792:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 32us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120972.238855:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 337 00000100:00100000:1.0:1789120972.240897:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947489152 00000100:00100000:1.0:1789120972.240915:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947489152 00000100:00100000:2.0:1789120972.241051:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947489664 00000100:00100000:2.0:1789120972.241057:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947489664 00000100:00080000:3.0:1789120972.241881:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789120972.243495:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947489536 00000100:00100000:0.0:1789120972.243513:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947489536 00000100:00100000:0.0:1789120972.243628:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 105 00000100:00100000:0.0:1789120972.243641:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2410:x1876028947489664:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120972.243765:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2410:x1876028947489664:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 126us (5691us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120972.243774:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 105 00000100:00100000:0.0:1789120972.243797:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00100000:0.0:1789120972.243804:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784895a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947489536:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120972.243899:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784895a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947489536:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 95us (5756us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120972.243906:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00080000:3.0:1789120972.244038:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120972.246576:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 454 00000100:00100000:1.0:1789120972.246605:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947489152:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120972.246687:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947489152:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 95us (8722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120972.246695:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 454 00010000:00010000:0.0:1789120972.502283:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120972.705535:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970649472:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789120972.705630:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120972.705732:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970649472 00000100:00100000:0.0:1789120972.705742:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970649472 00000100:00100000:0.0:1789120972.705804:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789120972.705815:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970649472:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120972.705878:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120972.705928:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970649472:12345-0@lo:13:osp-pre-1-1.0 Request processed in 114us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120972.705937:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789120972.706001:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970649472:0@lo:13:osp-pre-1-1.0 00000040:00080000:0.0:1789120972.892498:0:14972:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120972.892511:0:14972:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120972.892541:0:14972:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789120972.892547:0:14972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789120973.084330:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.084496:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947490176 00000100:00100000:3.0:1789120973.084508:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947490176 00000100:00100000:3.0:1789120973.084584:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 94 00000100:00100000:3.0:1789120973.084596:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:11615:x1876028947490176:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120973.084624:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120973.084652:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fa50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eae2 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.084795:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa57 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.084813:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.084877:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa57 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120973.084892:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:3.0:1789120973.085031:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fa50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae2 expref: 21 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.085057:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa57 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae2 expref: 20 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.085068:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120973.085071:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789120973.085075:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d600, rc 0) 00000100:00100000:3.0:1789120973.085159:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:11615:x1876028947490176:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 565us (844us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1789120973.085168:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 94 00000100:00100000:0.0:1789120973.089524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.092406:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947490304 00000100:00100000:3.0:1789120973.092425:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947490304 00000100:00100000:3.0:1789120973.092513:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:3.0:1789120973.092525:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:11615:x1876028947490304:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:3.0:1789120973.092628:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fa65 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.092652:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fa65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.092668:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fa65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.092908:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fa6c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.092933:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fa6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.092947:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fa6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.093053:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa73 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102625:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102653:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120973.102720:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102737:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fa65 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102744:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fa65 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102752:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fa65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102758:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120973.102762:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fa65 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102786:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fa65 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102800:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120973.102803:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120973.102808:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fa65 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102814:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fa65 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102844:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fa6c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102851:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fa6c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102856:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fa6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102861:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120973.102864:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fa6c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102869:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fa6c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102876:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468a3b96800) 00010000:00010000:3.0:1789120973.102878:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120973.102881:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fa6c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102896:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fa6c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102915:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa73 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102921:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa73 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102926:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102931:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217de00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120973.102934:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa73 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102939:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa73 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102946:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9468a3b96500) 00010000:00010000:3.0:1789120973.102948:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120973.102951:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa73 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.102956:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa73 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120973.103138:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:11615:x1876028947490304:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 10609us (13624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120973.103149:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:3.0:1789120973.179386:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120973.179524:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947490560 00000100:00100000:2.0:1789120973.179538:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947490560 00000100:00100000:2.0:1789120973.179623:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00100000:2.0:1789120973.179636:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:11618:x1876028947490560:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789120973.179667:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120973.179699:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa7a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eae9 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.179799:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fa81 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.179860:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fa81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.179877:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fa81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.179898:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fa88 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.179927:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fa88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.179935:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fa88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180096:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fa8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180106:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fa8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180114:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fa8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120973.180127:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789120973.180448:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fa81 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180458:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fa81 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180466:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fa81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180474:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120973.180479:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fa81 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180489:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fa81 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180519:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:2.0:1789120973.180522:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120973.180531:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fa81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180538:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fa81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180555:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fa88 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180562:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fa88 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180568:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fa88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180574:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120973.180577:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fa88 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180584:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fa88 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180593:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff946888819900) 00010000:00010000:2.0:1789120973.180595:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120973.180599:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fa88 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180605:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fa88 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180674:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fa7a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae9 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180691:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fa8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae9 expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.180699:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:2.0:1789120973.180702:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120973.180704:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0000, rc 0) 00000100:00100000:2.0:1789120973.181294:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:11618:x1876028947490560:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1657us (1921us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789120973.181306:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00100000:2.0:1789120973.214087:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.214226:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947490688 00000100:00100000:3.0:1789120973.215001:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947490688 00000100:00100000:3.0:1789120973.215076:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 97 00000100:00100000:3.0:1789120973.215087:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:11618:x1876028947490688:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:3.0:1789120973.215180:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa9d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.215203:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.215219:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.215387:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa9d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.215397:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa9d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.215406:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.215413:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217de00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120973.215419:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa9d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.215429:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa9d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.215444:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:3.0:1789120973.215448:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120973.215464:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa9d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.215472:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fa9d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120973.215566:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:11618:x1876028947490688:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 479us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120973.215576:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 97 00000100:00100000:3.0:1789120973.221634:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.221682:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947490944 00000100:00100000:3.0:1789120973.221696:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947490944 00000100:00100000:3.0:1789120973.221766:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789120973.221779:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:11618:x1876028947490944:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789120973.223707:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913fe850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:11618:x1876028947490944:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 1914us (2074us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1789120973.223721:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789120973.337326:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120973.337755:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947491200 00000100:00100000:2.0:1789120973.337768:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947491200 00000100:00100000:2.0:1789120973.337890:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 98 00000100:00100000:2.0:1789120973.337903:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:11133:x1876028947491200:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789120973.337941:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120973.337981:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830faa4 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eaf0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.338130:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.338147:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fa8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae9 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.338175:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.338223:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fa8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae9 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.338239:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fa8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae9 expref: 24 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120973.338256:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970649600:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120973.338397:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120973.358868:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970649600:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120973.358913:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120973.360465:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120973.360683:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947491328 00000100:00100000:2.0:1789120973.360694:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947491328 00010000:00010000:2.0:1789120973.360749:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fa8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae9 expref: 25 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120973.360898:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:2.0:1789120973.360910:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+25:2410:x1876028947491328:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120973.360930:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120973.360939:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fa8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae9 expref: 25 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.360992:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fa8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae9 expref: 25 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.361021:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fa8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae9 expref: 25 pid: 6518 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.361042:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:2.0:1789120973.361048:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.361059:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.361068:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.361108:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120973.361192:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:2410:x1876028947491328:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 283us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120973.361200:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 77 00010000:00010000:3.0:1789120973.361266:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.361276:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120973.361301:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789120973.361469:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830faa4 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf0 expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.361488:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf0 expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.361504:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:3.0:1789120973.361508:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789120973.361510:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1200, rc 0) 00000100:00100000:3.0:1789120973.361544:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:11133:x1876028947491200:12345-192.168.202.32@tcp:101:bash.0 Request processed in 23643us (24233us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1789120973.361551:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 98 00000100:00100000:3.0:1789120973.364202:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120973.370117:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947491456 00000100:00100000:0.0:1789120973.370142:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947491456 00000100:00100000:0.0:1789120973.370259:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 99 00000100:00100000:0.0:1789120973.370273:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:11133:x1876028947491456:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120973.370310:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120973.370360:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fab9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eaf7 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120973.370412:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fac0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120973.370429:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fac0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120973.370444:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fac0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120973.370589:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fab9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf7 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120973.370610:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fac0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf7 expref: 25 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120973.370618:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:0.0:1789120973.370621:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789120973.370625:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22400, rc 0) 00000100:00100000:0.0:1789120973.370717:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+25:11133:x1876028947491456:12345-192.168.202.32@tcp:101:bash.0 Request processed in 446us (6546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120973.370724:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 99 00000100:00100000:0.0:1789120973.374127:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.376058:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947491712 00000100:00100000:3.0:1789120973.376083:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947491712 00000100:00100000:3.0:1789120973.376475:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 100 00000100:00100000:3.0:1789120973.376489:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+25:11133:x1876028947491712:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:3.0:1789120973.377016:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.377041:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.377056:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789120973.378329:0:9342:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:3.0:1789120973.378397:0:9342:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001fccfa16 reply state 00000000794a5eef transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.378419:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.378429:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:3.0:1789120973.378450:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789120973.378456:0:9342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789120973.378536:0:9342:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:3.0:1789120973.378757:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:11133:x1876028947491712:12345-192.168.202.32@tcp:36:bash.0 Request processed in 2266us (4639us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1789120973.378769:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 100 00000020:00080000:3.0:1789120973.378777:0:9342:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789120973.387268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.387447:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947491840 00000100:00100000:3.0:1789120973.387461:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947491840 00000100:00100000:3.0:1789120973.387539:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00100000:3.0:1789120973.387552:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:11133:x1876028947491840:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789120973.387586:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120973.387616:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830face lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eafe expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.393892:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830face lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eafe expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.393932:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830face lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eafe expref: 30 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.393991:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:3.0:1789120973.393996:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789120973.394001:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d200, rc 0) 00000100:00100000:3.0:1789120973.394102:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:11133:x1876028947491840:12345-192.168.202.32@tcp:101:bash.0 Request processed in 6551us (6849us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120973.394113:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00100000:2.0:1789120973.398330:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120973.398756:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947491968 00000100:00100000:0.0:1789120973.398768:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947491968 00000100:00100000:0.0:1789120973.398898:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:0.0:1789120973.398911:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:11133:x1876028947491968:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120973.398954:0:9116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120973.398994:0:9116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eddf95e5/0xb74d2367a830fad5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb05 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789120973.399032:0:9116:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3d1c8, atime: 0x6aa3d1c7, ctime: 0x6aa3d1c8, blocks: 0x8 00010000:00010000:0.0:1789120973.399064:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=423s v=(0 0) 00010000:00010000:0.0:1789120973.399070:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120973.399079:0:9116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eddf95e5/0xb74d2367a830fad5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb05 expref: 7 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120973.399099:0:9116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eddf95e5/0xb74d2367a830fad5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb05 expref: 7 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120973.399115:0:9116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22600, rc 0) 00000100:00100000:0.0:1789120973.399188:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:11133:x1876028947491968:12345-192.168.202.32@tcp:101:bash.0 Request processed in 280us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120973.399197:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:1.0:1789120973.403901:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.405025:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947492096 00000100:00100000:3.0:1789120973.405060:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947492096 00002000:00010000:3.0:1789120973.405117:0:8438:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1789120973.405123:0:8438:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff946783f6e580 with x1876028947492096 ext(0->18446744073709551615) 00002000:00010000:3.0:1789120973.405139:0:8438:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946783f6e580. 00000100:00100000:3.0:1789120973.405183:0:8438:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:3.0:1789120973.405194:0:8438:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947492096:12345-192.168.202.32@tcp:10:bash.0 00002000:00010000:3.0:1789120973.405533:0:8438:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789120973.405538:0:8438:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 1789120968 -> 1789120972 00002000:00010000:3.0:1789120973.405541:0:8438:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb atime from disk: 1789120967 -> 1789120967 00002000:00010000:3.0:1789120973.405544:0:8438:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 1789120968 -> 1789120972 00002000:00010000:3.0:1789120973.405546:0:8438:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1789120973.405639:0:8438:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2411:x1876028947492096:12345-192.168.202.32@tcp:10:bash.0 Request processed in 445us (1750us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1789120973.405650:0:8438:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00002000:00010000:3.0:1789120973.405654:0:8438:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/3 (0->18446744073709551615) 00002000:00100000:3.0:1789120973.405657:0:8438:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff946783f6e580 with x1876028947492096 ext(0->18446744073709551615) 00002000:00010000:3.0:1789120973.405663:0:8438:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946783f6e580. 00010000:00010000:2.0:1789120973.522324:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120973.552919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.561589:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947492224 00000100:00100000:3.0:1789120973.561613:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947492224 00000100:00100000:3.0:1789120973.561722:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 102 00000100:00100000:3.0:1789120973.561735:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:11632:x1876028947492224:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:3.0:1789120973.561877:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fadc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.561900:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fadc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.561939:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fadc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.561971:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fae3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.561980:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.561988:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562086:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562096:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562103:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120973.562164:0:11088:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562192:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fadc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562199:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fadc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562207:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fadc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562225:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120973.562230:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fadc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562240:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fadc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562255:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120973.562258:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120973.562264:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fadc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562271:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fadc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562288:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fae3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562294:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fae3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562300:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fae3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562306:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217cc00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120973.562308:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fae3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562315:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fae3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562333:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468a3b96500) 00010000:00010000:3.0:1789120973.562336:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120973.562339:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fae3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562346:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fae3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562368:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562374:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faea lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562380:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562386:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217c000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120973.562389:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562395:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faea lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562402:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:3.0:1789120973.562404:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120973.562407:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faea lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.562413:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120973.562541:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:11632:x1876028947492224:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 806us (9634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120973.562552:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 102 00000100:00100000:2.0:1789120973.643116:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.643229:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947492480 00000100:00100000:3.0:1789120973.643243:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947492480 00000100:00100000:3.0:1789120973.643326:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 103 00000100:00100000:3.0:1789120973.643337:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:11635:x1876028947492480:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120973.643367:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120973.643395:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faf1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb0c expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.643489:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830faf8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.643507:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830faf8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.643520:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830faf8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.643673:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830faff lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.643684:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830faff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.643692:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830faff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.643891:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fb06 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.643902:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fb06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.643909:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fb06 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120973.643922:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789120973.644052:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830faf8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.644060:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830faf8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.644069:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830faf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.644076:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217cc00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120973.644081:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830faf8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.644090:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830faf8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.644106:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120973.644109:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120973.644114:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830faf8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.644135:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830faf8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.644156:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830faff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.644162:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830faff lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.644168:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830faff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.644173:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120973.645770:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830faff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.645787:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830faff lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.645807:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468a3b96500) 00010000:00010000:3.0:1789120973.645810:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120973.645817:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830faff lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.645841:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830faff lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.645933:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830faf1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb0c expref: 33 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.645952:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fb06 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb0c expref: 32 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.645991:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:3.0:1789120973.645993:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789120973.645996:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f11000, rc 0) 00000100:00100000:3.0:1789120973.649221:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:11635:x1876028947492480:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 5824us (6060us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1789120973.649238:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 103 00000100:00100000:1.0:1789120973.664333:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.666763:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947492608 00000100:00100000:3.0:1789120973.666784:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947492608 00000100:00100000:3.0:1789120973.666900:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 104 00000100:00100000:3.0:1789120973.666914:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:11635:x1876028947492608:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:3.0:1789120973.667027:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.667051:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf0 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.667064:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.667131:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf0 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.667148:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf0 expref: 32 pid: 6519 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120973.667167:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970649728:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120973.668058:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852cb9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120973.670975:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.671425:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482d00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970649728:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120973.671464:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120973.671569:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947492864 00000100:00100000:2.0:1789120973.671578:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947492864 00000100:00100000:2.0:1789120973.671654:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:2.0:1789120973.671668:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:6184:x1876028947492864:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789120973.672134:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:6184:x1876028947492864:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 468us (1181us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789120973.672143:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:2.0:1789120973.680254:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.680361:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947492992 00000100:00100000:3.0:1789120973.680373:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947492992 00010000:00010000:3.0:1789120973.680427:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf0 expref: 34 pid: 6519 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120973.680483:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 78 00000100:00100000:3.0:1789120973.680495:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:2412:x1876028947492992:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120973.680519:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120973.680527:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf0 expref: 34 pid: 6519 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.680553:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf0 expref: 34 pid: 6519 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.680583:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830faab lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf0 expref: 34 pid: 6519 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.680605:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:3.0:1789120973.680612:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.680624:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.680646:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.680688:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120973.680768:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:2412:x1876028947492992:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 275us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120973.680779:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 78 00010000:00010000:2.0:1789120973.681389:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.681401:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.681454:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.681460:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.681467:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.681473:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120973.681479:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.681486:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.681500:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:2.0:1789120973.681503:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120973.681507:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.681538:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb14 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120973.681614:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:11635:x1876028947492608:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 14701us (17296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120973.681623:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 104 00000100:00100000:0.0:1789120973.692986:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.693498:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947493248 00000100:00100000:3.0:1789120973.693512:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947493248 00000100:00100000:3.0:1789120973.693604:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:3.0:1789120973.693616:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:11635:x1876028947493248:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789120973.693982:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:11635:x1876028947493248:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 367us (1010us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789120973.693992:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000001:00080000:1.0:1789120973.719010:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1789120973.719038:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:1.0:1789120973.886794:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.887061:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947493504 00000100:00100000:3.0:1789120973.887074:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947493504 00000100:00100000:3.0:1789120973.887166:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 105 00000100:00100000:3.0:1789120973.887179:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:11647:x1876028947493504:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:3.0:1789120973.887212:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120973.887239:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fb1b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb13 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887341:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb22 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887361:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887398:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887417:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb29 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887425:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887431:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887565:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb30 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887576:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887584:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb30 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120973.887596:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:3.0:1789120973.887696:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb22 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887705:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb22 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887713:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887720:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120973.887732:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb22 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887742:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb22 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887755:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120973.887759:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120973.887764:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb22 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887771:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fb22 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887788:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb29 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887795:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb29 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887800:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887805:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217c000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120973.887807:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb29 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.887812:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb29 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.888019:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468a3b96500) 00010000:00010000:3.0:1789120973.888023:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120973.888032:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb29 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.888038:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb29 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.888099:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fb1b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb13 expref: 36 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.888115:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb30 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb13 expref: 35 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120973.888122:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:3.0:1789120973.888125:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120973.888127:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d400, rc 0) 00000100:00100000:3.0:1789120973.888204:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:11647:x1876028947493504:12345-192.168.202.32@tcp:101:cat.0 Request processed in 1028us (1425us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789120973.888212:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 105 00000100:00100000:2.0:1789120973.907389:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120973.907494:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947493760 00000100:00100000:3.0:1789120973.907508:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947493760 00000100:00100000:3.0:1789120973.907610:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:3.0:1789120973.907624:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:11647:x1876028947493760:12345-192.168.202.32@tcp:35:cat.0 00000100:00100000:3.0:1789120973.908327:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+36:11647:x1876028947493760:12345-192.168.202.32@tcp:35:cat.0 Request processed in 702us (947us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1789120973.908338:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:0.0:1789120973.949933:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120973.953388:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947494016 00000100:00100000:2.0:1789120973.953410:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947494016 00000100:00100000:2.0:1789120973.953515:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00100000:2.0:1789120973.953530:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+36:11648:x1876028947494016:12345-192.168.202.32@tcp:36:rm.0 00010000:00010000:2.0:1789120973.953612:0:9342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1789120973.953648:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830face lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eafe expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.953679:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb30 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb13 expref: 35 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.953710:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fb06 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb0c expref: 34 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.953725:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fac0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eaf7 expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.953737:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:2.0:1789120973.953743:0:9342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120973.953790:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fb3e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.953805:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fb3e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.953816:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fb3e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.953911:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.953919:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.953926:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954061:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fb4c lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954070:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fb4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954077:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fb4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120973.954479:0:9342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1789120973.954491:0:9342:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 424143669405ns, next at 425143665868ns, rc = 0 00010000:00010000:2.0:1789120973.954553:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fb53 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954563:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fb53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954583:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fb53 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954592:0:9342:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fb53 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954600:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fb53 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954606:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fb53 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954639:0:9342:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789120973.954663:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fb4c lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954669:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fb4c lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954675:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fb4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954682:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120973.954687:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fb4c lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954696:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fb4c lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954706:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:2.0:1789120973.954709:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789120973.954721:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fb4c lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954729:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fb4c lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954750:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fb3e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954757:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fb3e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954763:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fb3e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954768:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120973.954771:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fb3e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954777:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fb3e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954786:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:2.0:1789120973.954788:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120973.954792:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fb3e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.954799:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fb3e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120973.954810:0:9342:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000004bda98dd reply state 00000000c9aeb939 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120973.955521:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120973.955532:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fb53 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120973.955540:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789120973.955544:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fb53 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120973.955552:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fb53 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120973.955572:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:1.0:1789120973.955575:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789120973.955579:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fb53 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120973.955585:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fb53 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120973.955612:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120973.955614:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120973.955616:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120973.955681:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120973.955755:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff946888819900) 00010000:00010000:2.0:1789120973.955758:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789120973.955762:0:9342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120973.956090:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:11648:x1876028947494016:12345-192.168.202.32@tcp:36:rm.0 Request processed in 2558us (6168us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1789120973.956681:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00100000:2.0:1789120974.029422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120974.029738:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947494272 00000100:00100000:3.0:1789120974.029750:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947494272 00000100:00100000:3.0:1789120974.029912:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 107 00000100:00100000:3.0:1789120974.029926:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf715680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:11654:x1876028947494272:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789120974.029991:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120974.030020:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb5a lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb1a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.030183:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb61 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.030201:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.030216:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.030229:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.030237:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.030244:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789120974.030565:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1789120974.031604:0:6519:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789120974.031996:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fb6f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032016:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fb6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032029:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fb6f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032494:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb61 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032503:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb61 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032511:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb61 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032519:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217cc00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120974.032525:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb61 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032535:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb61 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032550:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120974.032554:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120974.032561:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb61 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032568:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb61 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120974.032590:0:6519:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000369d1cb9 reply state 000000001da61539 transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032605:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032612:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff946888819900) 00010000:00010000:3.0:1789120974.032621:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789120974.032625:0:6519:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789120974.032676:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb5a lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb1a expref: 37 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032695:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fb6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb1a expref: 36 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.032703:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96500) 00010000:00010000:3.0:1789120974.032704:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120974.032707:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d200, rc 0) 00000100:00100000:3.0:1789120974.032810:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf715680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:11654:x1876028947494272:12345-192.168.202.32@tcp:101:bash.0 Request processed in 2888us (3401us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1789120974.035611:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 107 00000100:00100000:3.0:1789120974.041584:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120974.045551:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947494400 00000100:00100000:0.0:1789120974.045572:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947494400 00000100:00100000:0.0:1789120974.046096:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:0.0:1789120974.046122:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946891482d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947494400:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120974.046159:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120974.046189:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a830fb7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb21 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789120974.046257:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789120974.046286:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=424s v=(0 0) 00010000:00010000:0.0:1789120974.046291:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120974.046721:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a830fb7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb21 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.046749:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a830fb7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb21 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.046768:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22c00, rc 0) 00000100:00100000:0.0:1789120974.046897:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946891482d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947494400:12345-192.168.202.32@tcp:101:bash.0 Request processed in 781us (5328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120974.046906:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00080000:2.0:1789120974.055451:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789120974.060690:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120974.061159:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947494528 00000100:00100000:1.0:1789120974.061175:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947494528 00000100:00100000:1.0:1789120974.061254:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:1.0:1789120974.061266:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:11654:x1876028947494528:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789120974.061292:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120974.061329:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb28 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.061371:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a830fb7d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb21 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.061382:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120974.061388:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120974.061394:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.061438:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a830fb7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb21 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.061455:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a830fb7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb21 expref: 7 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120974.061473:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876028970649856:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789120974.061616:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3a840 going to sleep for 11 seconds 00000100:00100000:3.0:1789120974.071280:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f43c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876028970649856:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789120974.072217:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00010000:00010000:3.0:1789120974.072444:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.072475:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3a00, rc 0) 00000100:00100000:3.0:1789120974.072563:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:11654:x1876028947494528:12345-192.168.202.32@tcp:101:bash.0 Request processed in 11299us (11888us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120974.072574:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:2.0:1789120974.078239:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947494656 00000100:00100000:2.0:1789120974.078262:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947494656 00010000:00010000:2.0:1789120974.078711:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a830fb7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb21 expref: 7 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.078773:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 79 00000100:00100000:2.0:1789120974.078786:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947494656:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120974.078806:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120974.079499:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a830fb7d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb21 expref: 7 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.079525:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a830fb7d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb21 expref: 7 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.079584:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a830fb7d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb21 expref: 7 pid: 8435 timeout: 524 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.079605:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120974.079610:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120974.079620:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.079633:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.079690:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.079709:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf716580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1876028970649984:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789120974.081073:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120974.089884:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf716580 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:10341:1876028970649984:192.168.202.32@tcp:105: 00010000:00010000:2.0:1789120974.089925:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120974.090004:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947494656:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 11220us (17793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120974.090018:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 79 00000100:00100000:3.0:1789120974.103773:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120974.106224:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947494912 00000100:00100000:0.0:1789120974.106244:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947494912 00000100:00100000:0.0:1789120974.106363:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:0.0:1789120974.106378:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:11654:x1876028947494912:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:0.0:1789120974.106777:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:11654:x1876028947494912:12345-192.168.202.32@tcp:35:bash.0 Request processed in 401us (3018us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1789120974.106787:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:0.0:1789120974.364146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120974.364411:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947495040 00000100:00100000:3.0:1789120974.364424:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947495040 00000100:00100000:3.0:1789120974.364553:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 108 00000100:00100000:3.0:1789120974.364565:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:11670:x1876028947495040:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120974.364623:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120974.364651:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb2f expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.364733:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb92 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.364751:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.364765:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120974.364854:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789120974.364858:0:11088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120974.364884:0:11088:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb92 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.364912:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fb8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb2f expref: 40 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.364936:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb92 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb2f expref: 39 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.364945:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120974.364976:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120974.364981:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217cc00, rc 0) 00000100:00100000:3.0:1789120974.365072:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:11670:x1876028947495040:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 509us (1487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120974.365081:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 108 00000100:00100000:1.0:1789120974.373152:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120974.374114:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947495296 00000100:00100000:0.0:1789120974.374129:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947495296 00000100:00100000:0.0:1789120974.374292:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 109 00000100:00100000:0.0:1789120974.374368:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:11670:x1876028947495296:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789120974.374397:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120974.374427:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fb99 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb36 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.374700:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fba0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.374720:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fba0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.374734:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fba0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120974.374748:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789120974.375032:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fb99 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb36 expref: 42 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.375057:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fba0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb36 expref: 41 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.375067:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96500) 00010000:00010000:0.0:1789120974.375071:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120974.375076:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22800, rc 0) 00000100:00100000:0.0:1789120974.379001:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7012c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+41:11670:x1876028947495296:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 4619us (5845us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1789120974.379019:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 109 00000100:00100000:0.0:1789120974.384609:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120974.384727:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120974.385175:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947495680 00000100:00100000:3.0:1789120974.385188:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947495680 00000100:00100000:3.0:1789120974.385366:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:3.0:1789120974.385379:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+41:11670:x1876028947495680:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120974.385417:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120974.385452:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fbae lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb3d expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.385460:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947495424 00000100:00100000:2.0:1789120974.385465:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947495424 00000100:00100000:2.0:1789120974.385572:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:2.0:1789120974.385593:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:2412:x1876028947495424:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120974.385604:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120974.385622:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbb5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.385628:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830fba0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb36 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.385639:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.385652:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96500) 00010000:00010000:3.0:1789120974.385653:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbb5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.385657:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:3.0:1789120974.385666:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00000100:00100000:2.0:1789120974.385730:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d9a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:2412:x1876028947495424:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 139us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120974.385739:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00010000:00010000:3.0:1789120974.386086:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fbae lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb3d expref: 43 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.386105:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbb5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb3d expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.386115:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96500) 00010000:00010000:3.0:1789120974.386118:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789120974.386121:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f11000, rc 0) 00000100:00100000:3.0:1789120974.386150:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+42:11670:x1876028947495680:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 774us (1423us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1789120974.386168:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:2.0:1789120974.393627:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120974.393723:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947495808 00000100:00100000:1.0:1789120974.393734:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947495808 00000100:00100000:1.0:1789120974.393811:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:1.0:1789120974.393850:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947495808:12345-192.168.202.32@tcp:1:lfs.0 00010000:00010000:1.0:1789120974.393920:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.393947:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.393967:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120974.393972:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120974.393977:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.394057:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 6 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.394073:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 6 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120974.394091:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876028970650112:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789120974.394220:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3aa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789120974.403889:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876028970650112:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120974.403935:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.409274:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120974.410029:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947495936 00000100:00100000:1.0:1789120974.410054:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947495936 00002000:00100000:1.0:1789120974.410141:0:8440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9468bf717c00 x1876028947495936/t0(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:505/0 lens 504/0 e 0 to 0 dl 1789120985 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120974.410154:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468bf717c00 with x1876028947495936 ext(0->8) 00010000:00010000:1.0:1789120974.410167:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 7 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.410186:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 7 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789120974.410194:0:8440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9468bf717c00 00000100:00100000:1.0:1789120974.410241:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:1.0:1789120974.410253:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947495936:12345-192.168.202.32@tcp:4:lfs.0 00000100:00100000:1.0:1789120974.412187:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf717c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2412:x1876028947495936:12345-192.168.202.32@tcp:4:lfs.0 Request processed in 1922us (2915us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789120974.412205:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00002000:00100000:1.0:1789120974.412217:0:8440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9468bf717c00 x1876028947495936/t4294967303(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:505/0 lens 504/448 e 0 to 0 dl 1789120985 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120974.412229:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468bf717c00 with x1876028947495936 ext(0->8) 00010000:00010000:1.0:1789120974.412252:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 9 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.412288:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 9 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789120974.412297:0:8440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9468bf717c00 00000100:00100000:0.0:1789120974.424074:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120974.424256:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947496064 00000100:00100000:1.0:1789120974.424270:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947496064 00010000:00010000:1.0:1789120974.424341:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 9 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120974.424400:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:1.0:1789120974.424412:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2410:x1876028947496064:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120974.424434:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1789120974.424459:0:6503:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789120974.424461:0:6503:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1789120973 00002000:00010000:1.0:1789120974.424464:0:6503:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1789120973 00002000:00010000:1.0:1789120974.424477:0:6503:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1789120973 00002000:00010000:1.0:1789120974.424480:0:6503:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:1.0:1789120974.424488:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 9 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.424504:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 9 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.424535:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bec4cdea/0xb74d2367a830fb84 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb28 expref: 9 pid: 8433 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.424584:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120974.424590:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120974.424597:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.424609:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.424654:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120974.424722:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d8b40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2410:x1876028947496064:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 311us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120974.424731:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 80 00010000:00010000:3.0:1789120974.424961:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.424974:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.425000:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.425010:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.425019:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.425028:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789120974.425033:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.425044:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.425059:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.425082:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ea70adb/0xb74d2367a830fbc3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120974.425158:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf716580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947495808:12345-192.168.202.32@tcp:1:lfs.0 Request processed in 31336us (31545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120974.425168:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:2.0:1789120974.436441:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120974.436732:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947496320 00000100:00100000:0.0:1789120974.436745:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947496320 00000100:00100000:2.0:1789120974.437265:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:2.0:1789120974.437279:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+42:11670:x1876028947496320:12345-192.168.202.32@tcp:35:lfs.0 00000004:00010000:2.0:1789120974.437382:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbb5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb3d expref: 42 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120974.437715:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1789120974.437752:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1789120974.438726:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1789120974.438800:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.439162:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fb6f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb1a expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.439191:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.439242:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fb6f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb1a expref: 46 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.439262:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fb6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb1a expref: 46 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.439280:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf715a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1876028970650240:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120974.441767:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7300 going to sleep for 11 seconds 00000100:00100000:2.0:1789120974.447714:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120974.447867:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947496448 00000100:00100000:0.0:1789120974.447879:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947496448 00010000:00010000:0.0:1789120974.447936:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fb6f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb1a expref: 47 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120974.447999:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 81 00000100:00100000:0.0:1789120974.448011:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+47:2412:x1876028947496448:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120974.448032:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120974.448050:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fb6f lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb1a expref: 47 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.448067:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fb6f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb1a expref: 47 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.448107:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96500) 00010000:00010000:0.0:1789120974.448115:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.448127:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.448137:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.448162:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120974.448226:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7143c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+47:2412:x1876028947496448:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 217us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120974.448262:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 81 00010000:00010000:1.0:1789120974.450015:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fb6f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb1a expref: 46 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120974.450164:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf715a40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1876028970650240:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120974.450200:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.450212:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.450219:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789120974.450619:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:1.0:1789120974.450787:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1789120974.451309:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1876028970650368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789120974.451407:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120974.451455:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3a840 going to sleep for 11 seconds 00000100:00100000:2.0:1789120974.451658:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970650368 00000100:00100000:2.0:1789120974.451667:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970650368 00000100:00100000:2.0:1789120974.451763:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789120974.451776:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1876028970650368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789120974.451922:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1876028970650368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 149us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120974.451931:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789120974.452128:0:6522:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:1.0:1789120974.452136:0:6522:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:1.0:1789120974.452164:0:6522:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9468914f2580, transno 4294967302 00000100:00100000:1.0:1789120974.452187:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1876028970650368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789120974.452360:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:1.0:1789120974.452426:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1876028970650496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789120974.452655:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120974.452693:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120974.452714:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970650496 00000100:00100000:1.0:1789120974.452719:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970650496 00000100:00100000:1.0:1789120974.452752:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1789120974.452759:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6522:x1876028970650496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1789120974.452957:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120974.453227:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6522:x1876028970650496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 467us (758us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789120974.453246:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789120974.453804:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1876028970650496:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789120974.454092:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1789120974.454153:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.454166:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.454174:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.454200:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120974.454206:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.454216:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.454487:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96500) 00010000:00010000:2.0:1789120974.454492:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789120974.454499:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.454508:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbca lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789120974.454653:0:6522:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789120974.454723:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:2.0:1789120974.454738:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 424643916898ns, next at 425643914274ns, rc = 0 00000001:00080000:2.0:1789120974.454746:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1789120974.454775:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96500) 00010000:00010000:2.0:1789120974.454779:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789120974.454787:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbb5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb3d expref: 50 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.454992:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913fdc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+49:11670:x1876028947496320:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 17716us (18565us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1789120974.455004:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000020:00080000:2.0:1789120974.455011:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789120974.458799:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120974.459561:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947496576 00000100:00100000:3.0:1789120974.459576:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947496576 00000100:00100000:3.0:1789120974.459703:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 111 00000100:00100000:3.0:1789120974.459716:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+49:11670:x1876028947496576:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120974.459751:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120974.459786:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fbd1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb44 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.459994:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fbd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb44 expref: 50 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.460013:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fbd1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb44 expref: 50 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.460036:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:3.0:1789120974.460041:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789120974.460054:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f10e00, rc 0) 00000100:00100000:3.0:1789120974.460174:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf715e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+50:11670:x1876028947496576:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 461us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120974.460182:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 111 00000100:00100000:0.0:1789120974.466374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120974.466591:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947496832 00000100:00100000:3.0:1789120974.466604:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947496832 00000100:00100000:3.0:1789120974.466683:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:3.0:1789120974.466696:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+50:11670:x1876028947496832:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789120974.467078:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+51:11670:x1876028947496832:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 384us (719us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789120974.467088:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 27 00010000:00010000:0.0:1789120974.546645:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120974.583704:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120974.584446:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947496960 00000100:00100000:0.0:1789120974.584461:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947496960 00000100:00100000:2.0:1789120974.584754:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 112 00000100:00100000:2.0:1789120974.584780:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+51:11680:x1876028947496960:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:2.0:1789120974.584925:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbd8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.584957:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbd8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.584974:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbd8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.584988:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fbdf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.584996:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fbdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585002:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fbdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585113:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fbe6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585122:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585130:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120974.585196:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585246:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbd8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585254:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbd8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585263:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbd8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585270:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120974.585274:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbd8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585283:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbd8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585297:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:2.0:1789120974.585300:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120974.585307:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbd8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585314:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fbd8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585330:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fbdf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585336:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fbdf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585342:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fbdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585354:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120974.585357:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fbdf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585364:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fbdf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585373:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff946888819900) 00010000:00010000:2.0:1789120974.585375:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120974.585379:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fbdf lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585385:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fbdf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585396:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fbe6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585403:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fbe6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585409:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fbe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585414:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120974.585417:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fbe6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585423:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fbe6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585441:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120974.585443:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120974.585447:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fbe6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.585453:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fbe6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.585562:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+51:11680:x1876028947496960:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 784us (1871us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120974.585572:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 112 00000100:00100000:0.0:1789120974.627611:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120974.628367:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947497216 00000100:00100000:3.0:1789120974.628383:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947497216 00000100:00100000:3.0:1789120974.628464:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 113 00000100:00100000:3.0:1789120974.628477:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+51:11683:x1876028947497216:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120974.628508:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120974.628536:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fbed lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb4b expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.628672:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbf4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.628691:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.628707:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.628721:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fbfb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.628738:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fbfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.628745:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fbfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629050:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc02 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629061:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629069:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc02 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120974.629081:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789120974.629320:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbf4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629328:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbf4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629336:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629343:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120974.629348:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbf4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629357:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbf4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629383:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120974.629386:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120974.629393:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbf4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629400:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fbf4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629418:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fbfb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629425:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fbfb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629431:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fbfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629437:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120974.629440:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fbfb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629448:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fbfb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629456:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff946888819900) 00010000:00010000:3.0:1789120974.629459:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120974.629462:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fbfb lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629469:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fbfb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629526:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fbed lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb4b expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629541:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb4b expref: 53 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.629549:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:3.0:1789120974.629551:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120974.629554:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217c000, rc 0) 00000100:00100000:3.0:1789120974.629650:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914db840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+53:11683:x1876028947497216:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1174us (2052us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1789120974.629660:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 113 00000100:00100000:3.0:1789120974.635433:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120974.635620:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947497344 00000100:00100000:2.0:1789120974.635633:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947497344 00000100:00100000:2.0:1789120974.635717:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:2.0:1789120974.635730:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+53:11683:x1876028947497344:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:2.0:1789120974.635892:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc10 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.635915:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.635931:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.635988:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc10 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.635997:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc10 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.636028:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.636035:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120974.636040:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc10 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.636050:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc10 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.636066:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120974.636070:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120974.636077:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc10 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.636084:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc10 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.636187:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914812c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+53:11683:x1876028947497344:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 458us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120974.636197:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:1.0:1789120974.639634:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120974.639734:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947497600 00000100:00100000:3.0:1789120974.639746:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947497600 00000100:00100000:3.0:1789120974.640076:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:3.0:1789120974.640091:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+53:11683:x1876028947497600:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789120974.641302:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:11683:x1876028947497600:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 1206us (1676us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1789120974.641316:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:0.0:1789120974.733430:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120974.733630:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947497856 00000100:00100000:2.0:1789120974.733643:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947497856 00000100:00100000:2.0:1789120974.733775:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:2.0:1789120974.733788:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:11693:x1876028947497856:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789120974.733885:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120974.733890:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789120974.733930:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fb92 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb2f expref: 54 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.733998:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:2.0:1789120974.734005:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120974.734025:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc17 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb52 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.734170:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.734188:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc02 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb4b expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.734199:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.734246:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb4b expref: 54 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.734263:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb4b expref: 54 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.734280:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf714b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970650624:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120974.734582:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789120974.746739:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120974.747696:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf714b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970650624:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120974.747732:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120974.748068:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947497984 00000100:00100000:3.0:1789120974.748078:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947497984 00010000:00010000:3.0:1789120974.748192:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb4b expref: 55 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120974.748294:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 82 00000100:00100000:3.0:1789120974.748384:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+55:2411:x1876028947497984:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120974.748406:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120974.748415:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc02 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb4b expref: 55 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.748428:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc02 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb4b expref: 55 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.748457:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc02 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb4b expref: 55 pid: 6519 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.748477:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:3.0:1789120974.748482:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.748494:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.748504:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.748538:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120974.748614:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:2411:x1876028947497984:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 232us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120974.748624:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 82 00010000:00010000:2.0:1789120974.749047:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.749066:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120974.749097:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789120974.749272:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc17 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb52 expref: 55 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.749293:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb52 expref: 54 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.749311:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120974.749315:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789120974.749318:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1e00, rc 0) 00000100:00100000:2.0:1789120974.749404:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914db0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:11693:x1876028947497856:12345-192.168.202.32@tcp:101:bash.0 Request processed in 15618us (15989us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1789120974.749412:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:0.0:1789120974.753710:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120974.757428:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947498112 00000100:00100000:2.0:1789120974.757451:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947498112 00000100:00100000:2.0:1789120974.757618:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:2.0:1789120974.757631:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:11693:x1876028947498112:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789120974.757665:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120974.757694:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fc2c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb59 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.757746:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fc33 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.757790:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fc33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.757806:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fc33 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.758161:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fc2c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb59 expref: 56 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.758187:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fc33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb59 expref: 55 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.758196:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120974.758199:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789120974.758206:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0000, rc 0) 00000100:00100000:2.0:1789120974.758440:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+55:11693:x1876028947498112:12345-192.168.202.32@tcp:101:bash.0 Request processed in 810us (4744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120974.758449:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:0.0:1789120974.762247:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120974.762722:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947498368 00000100:00100000:3.0:1789120974.762735:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947498368 00000100:00100000:3.0:1789120974.762813:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00100000:3.0:1789120974.762844:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+55:11693:x1876028947498368:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:3.0:1789120974.763442:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.763466:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.763481:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789120974.763532:0:9342:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:3.0:1789120974.763555:0:9342:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000be65bf8f reply state 00000000fbec6e9c transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.763570:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.763578:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:3.0:1789120974.763582:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789120974.763587:0:9342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789120974.763774:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914da940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+58:11693:x1876028947498368:12345-192.168.202.32@tcp:36:bash.0 Request processed in 931us (1541us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1789120974.763784:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 117 00000020:00080000:3.0:1789120974.763791:0:9342:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789120974.767599:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120974.767712:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947498496 00000100:00100000:2.0:1789120974.767726:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947498496 00000100:00100000:2.0:1789120974.767805:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 118 00000100:00100000:2.0:1789120974.768076:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+58:11693:x1876028947498496:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120974.768249:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120974.768281:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fc41 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb60 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.768473:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.768491:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb52 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.768501:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.768544:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb52 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.768561:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb52 expref: 59 pid: 6520 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120974.768601:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914d8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970650752:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120974.768766:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860daf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789120974.773602:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120974.774338:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947498624 00000100:00100000:2.0:1789120974.774351:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947498624 00010000:00010000:2.0:1789120974.774412:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb52 expref: 60 pid: 6520 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.774474:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 83 00000100:00100000:2.0:1789120974.774505:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:2411:x1876028947498624:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120974.774526:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120974.774535:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb52 expref: 60 pid: 6520 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.774550:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb52 expref: 60 pid: 6520 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.774580:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120974.774586:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.774597:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.774606:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.774630:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120974.775195:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:2411:x1876028947498624:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 687us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120974.775206:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 83 00010000:00010000:0.0:1789120974.776761:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc1e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb52 expref: 59 pid: 6520 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120974.776795:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914d8f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970650752:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120974.777014:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.777028:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.777035:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120974.777119:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789120974.777125:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789120974.777152:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.777194:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fc41 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb60 expref: 59 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.777213:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb60 expref: 58 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.777223:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:0.0:1789120974.777249:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120974.777254:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22400, rc 0) 00000100:00100000:0.0:1789120974.777510:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+58:11693:x1876028947498496:12345-192.168.202.32@tcp:101:bash.0 Request processed in 9692us (9925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120974.777522:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 118 00000100:00100000:1.0:1789120974.781808:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120974.782176:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947498880 00000100:00100000:2.0:1789120974.782188:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947498880 00000100:00100000:2.0:1789120974.782304:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:2.0:1789120974.782318:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+58:11693:x1876028947498880:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:2.0:1789120974.782623:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+59:11693:x1876028947498880:12345-192.168.202.32@tcp:35:bash.0 Request processed in 306us (827us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789120974.782656:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:0.0:1789120974.894246:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120974.895443:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947499008 00000100:00100000:3.0:1789120974.895460:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947499008 00000100:00100000:3.0:1789120974.895594:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 119 00000100:00100000:3.0:1789120974.895607:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+59:11699:x1876028947499008:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120974.895641:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120974.895670:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb67 expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.896457:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fc56 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.896483:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fc56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.896569:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fc56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120974.896634:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1789120974.896638:0:9342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120974.896664:0:9342:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fc56 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.896699:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb67 expref: 61 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.896725:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fc56 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb67 expref: 60 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.896736:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120974.896739:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120974.896744:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217cc00, rc 0) 00000100:00100000:3.0:1789120974.897142:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:11699:x1876028947499008:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1535us (2918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120974.897153:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 119 00000100:00100000:1.0:1789120974.903708:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120974.903869:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947499136 00000100:00100000:2.0:1789120974.903884:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947499136 00000100:00100000:2.0:1789120974.903971:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:2.0:1789120974.903984:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:11699:x1876028947499136:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789120974.904013:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120974.904051:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fc5d lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb6e expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.904294:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc64 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.904380:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.904396:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.904412:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc6b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.904420:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.904428:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.904719:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.904744:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.904752:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120974.904813:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789120974.905456:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789120974.905495:0:6518:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905571:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905581:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc64 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905588:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc64 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905595:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905601:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120974.905607:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc64 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905616:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc64 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905632:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:2.0:1789120974.905636:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120974.905655:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc64 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905662:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fc64 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905680:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc6b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905686:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc6b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905691:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905696:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120974.905699:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc6b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905706:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc6b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905713:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff946888819900) 00010000:00010000:2.0:1789120974.905715:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120974.905718:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc6b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905723:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fc6b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905762:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fc5d lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb6e expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905793:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb6e expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.905801:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120974.905804:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120974.905806:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082600, rc 0) 00000100:00100000:2.0:1789120974.906141:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+61:11699:x1876028947499136:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 2157us (2447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120974.906152:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:0.0:1789120974.915157:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120974.915226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120974.915332:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947499392 00000100:00100000:2.0:1789120974.915345:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947499392 00000100:00100000:2.0:1789120974.915434:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 121 00000100:00100000:2.0:1789120974.915445:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+61:11699:x1876028947499392:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789120974.915476:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120974.915508:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887083800/0xb74d2367a830fc79 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb75 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.915644:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.915662:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb60 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.915671:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb6e expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.915703:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.915747:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb6e expref: 62 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.915763:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb6e expref: 62 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.915778:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf714b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970650880:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120974.915960:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb60 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.915969:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb60 expref: 62 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120974.915977:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf714780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970651008:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120974.916002:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789120974.925282:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947499520 00000100:00100000:0.0:1789120974.927239:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120974.927290:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947499648 00000100:00100000:0.0:1789120974.927893:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947499648 00010000:00010000:0.0:1789120974.927965:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb60 expref: 63 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120974.928019:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 84 00000100:00100000:0.0:1789120974.928030:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+63:2411:x1876028947499648:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120974.928169:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120974.928179:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb60 expref: 63 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.928194:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb60 expref: 63 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.928223:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:0.0:1789120974.928230:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.928241:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.928268:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120974.928479:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947499520 00010000:00010000:3.0:1789120974.928511:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb6e expref: 64 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120974.928542:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:3.0:1789120974.928550:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+64:2412:x1876028947499520:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120974.928559:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120974.928565:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb6e expref: 64 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.928576:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb6e expref: 64 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.928589:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:3.0:1789120974.928593:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.928601:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.928610:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.928631:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120974.928680:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+64:2412:x1876028947499520:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 130us (13453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120974.928689:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 85 00000100:00100000:0.0:1789120974.928981:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+63:2411:x1876028947499648:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 951us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120974.928990:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 84 00010000:00010000:1.0:1789120974.930370:0:6520:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.202.32@tcp) returned -22 from blocking AST (req@000000009bf738f2 x1876028970650880) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb6e expref: 62 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.930424:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fc72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb6e expref: 62 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120974.930444:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf714b40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970650880:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120974.937395:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fc48 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb60 expref: 61 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120974.937437:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf714780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970651008:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120974.937477:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:1.0:1789120974.937488:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.937502:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.937509:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120974.937982:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789120974.938682:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887083800/0xb74d2367a830fc79 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb75 expref: 62 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.938710:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb75 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120974.938719:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:1.0:1789120974.938740:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789120974.938744:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082800, rc 0) 00000100:00100000:1.0:1789120974.938848:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+61:11699:x1876028947499392:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 23379us (23745us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1789120974.939187:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 121 00000100:00100000:0.0:1789120974.945990:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120974.946263:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947499904 00000100:00100000:2.0:1789120974.946276:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947499904 00000100:00100000:2.0:1789120974.946377:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:2.0:1789120974.946390:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+61:11699:x1876028947499904:12345-192.168.202.32@tcp:103:lfs.0 00010000:00010000:2.0:1789120974.946412:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120974.946446:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fbd1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb44 expref: 61 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120974.946493:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120974.946500:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120974.946576:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:11699:x1876028947499904:12345-192.168.202.32@tcp:103:lfs.0 Request processed in 188us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120974.946585:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:2.0:1789120974.950408:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120974.951068:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947500032 00000100:00100000:3.0:1789120974.951081:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947500032 00000100:00100000:3.0:1789120974.951183:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 122 00000100:00100000:3.0:1789120974.951215:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:11699:x1876028947500032:12345-192.168.202.32@tcp:58:lfs.0 00010000:00010000:3.0:1789120974.951555:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.951578:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120974.951594:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789120974.951728:0:9342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789120974.952423:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf714780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:11699:x1876028947500032:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 1205us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120974.952434:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 122 00000100:00100000:0.0:1789120974.960086:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120974.964480:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947500160 00000100:00100000:2.0:1789120974.964502:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947500160 00000100:00100000:0.0:1789120974.967352:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 123 00000100:00100000:0.0:1789120974.967370:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:11699:x1876028947500160:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789120974.967403:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120974.967437:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fc95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb7c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.967515:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.967529:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fc95 lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb7c expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.967553:0:6518:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.967571:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fc95 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb7c expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.967591:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:0.0:1789120974.967594:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789120974.967620:0:6518:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fc95 lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb7c expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120974.967629:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23200, rc 0) 00000100:00100000:0.0:1789120974.967727:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+61:11699:x1876028947500160:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 361us (7656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120974.967735:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 123 00000040:00080000:1.0:1789120975.058362:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120975.058375:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789120975.058422:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1789120975.058435:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789120975.058622:0:14508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914df0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970651136:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789120975.058875:0:14508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789120975.072601:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.072714:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947500288 00000100:00100000:2.0:1789120975.072727:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947500288 00000100:00100000:2.0:1789120975.072804:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:2.0:1789120975.072816:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+62:11700:x1876028947500288:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789120975.072910:0:6520:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789120975.073244:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+62:11700:x1876028947500288:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 428us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120975.073254:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:1.0:1789120975.073464:0:14508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914df0c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970651136:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789120975.077543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120975.083197:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947500416 00000100:00100000:3.0:1789120975.083218:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947500416 00000100:00100000:3.0:1789120975.083598:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:3.0:1789120975.083614:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+61:11700:x1876028947500416:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789120975.083730:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fc9c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.083753:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fc9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.083766:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fc9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.083788:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fca3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.083863:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fca3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.083873:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fca3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.083904:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcaa lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.083915:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.083922:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120975.083996:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789120975.084001:0:9342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120975.084018:0:9342:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084031:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fc9c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084037:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fc9c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084054:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fc9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084062:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f10e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120975.084067:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fc9c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084083:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fc9c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084109:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:3.0:1789120975.084112:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120975.084120:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fc9c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084127:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fc9c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084145:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fca3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084152:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fca3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084158:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fca3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084164:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120975.084167:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fca3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084174:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fca3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084182:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9468a3b96d00) 00010000:00010000:3.0:1789120975.084185:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120975.084188:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fca3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084205:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fca3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084229:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcaa lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084235:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcaa lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084242:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084247:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120975.084250:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcaa lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084257:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcaa lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084265:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:3.0:1789120975.084268:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120975.084271:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcaa lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.084277:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcaa lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120975.084599:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914da580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+61:11700:x1876028947500416:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 Request processed in 986us (7066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120975.084610:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:0.0:1789120975.093253:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.093406:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947500672 00000100:00100000:2.0:1789120975.093420:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947500672 00000100:00100000:2.0:1789120975.094585:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 126 00000100:00100000:2.0:1789120975.094622:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+61:11700:x1876028947500672:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120975.094652:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120975.094681:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb83 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.094843:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fcb8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.095772:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.095789:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120975.095810:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789120975.096546:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.096557:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fcb8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.096565:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fcb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.096572:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887083600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120975.096577:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fcb8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.096587:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fcb8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.097002:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120975.097006:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789120975.097012:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fcb8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.097019:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fcb8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.098015:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcb1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb83 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.098064:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:2.0:1789120975.098066:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120975.098072:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb83 expref: 63 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.098087:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082600, rc 0) 00000100:00100000:2.0:1789120975.098449:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+62:11700:x1876028947500672:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 3838us (5209us total) trans 4294967399 rc 301/301 00000100:00100000:2.0:1789120975.098460:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 126 00000100:00100000:1.0:1789120975.113667:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120975.113934:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947500800 00000100:00100000:3.0:1789120975.113956:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947500800 00000100:00100000:1.0:1789120975.114291:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 127 00000100:00100000:1.0:1789120975.114318:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+62:11700:x1876028947500800:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789120975.114369:0:6519:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789120975.114529:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+62:11700:x1876028947500800:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 216us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120975.114539:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 127 00000100:00100000:0.0:1789120975.120957:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120975.121255:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947501056 00000100:00100000:3.0:1789120975.121267:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947501056 00000100:00100000:3.0:1789120975.121357:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 128 00000100:00100000:3.0:1789120975.121369:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+62:11700:x1876028947501056:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120975.121401:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120975.121405:0:9342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789120975.121440:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a830fc56 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb67 expref: 62 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.121468:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789120975.121475:0:9342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120975.121491:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcc6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb8a expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789120975.122554:0:9342:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789120975.123045:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fccd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.123073:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fccd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.123086:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fccd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.123204:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11000/0xb74d2367a830fcc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb8a expref: 64 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.123231:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fccd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb8a expref: 63 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.123241:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff946888819000) 00010000:00010000:2.0:1789120975.123244:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120975.123266:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082600, rc 0) 00000100:00100000:2.0:1789120975.123365:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+63:11700:x1876028947501056:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1997us (2431us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789120975.123375:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 128 00000100:00100000:2.0:1789120975.127305:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120975.127487:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947501312 00000100:00100000:0.0:1789120975.127496:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947501312 00000100:00100000:0.0:1789120975.127623:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:0.0:1789120975.127635:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+63:11700:x1876028947501312:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789120975.127698:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120975.127728:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fccd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb8a expref: 63 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.127748:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff946888819000) 00010000:00010000:0.0:1789120975.127761:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120975.127785:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fcdb lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.127867:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fcdb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.127879:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fcdb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.127914:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fce2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x27a351ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.127923:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fce2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x27a351ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.127930:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fce2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x27a351ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.127999:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fcdb lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128006:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fcdb lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128012:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fcdb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128018:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120975.128024:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fcdb lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128032:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fcdb lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128041:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:0.0:1789120975.128044:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120975.128048:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fcdb lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128055:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fcdb lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128073:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fce2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x27a351ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128078:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fce2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x27a351ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128084:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fce2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x27a351ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128100:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120975.128104:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fce2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x27a351ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128111:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fce2 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0x27a351ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128119:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x27a351ea (ffff9468c1bd2d00) 00010000:00010000:0.0:1789120975.128122:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120975.128125:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fce2 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x27a351ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.128131:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fce2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0x27a351ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120975.128216:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf717840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+62:11700:x1876028947501312:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 583us (920us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120975.128225:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:0.0:1789120975.135479:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120975.135578:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947501440 00000100:00100000:3.0:1789120975.135590:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947501440 00000100:00100000:3.0:1789120975.135707:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 130 00000100:00100000:3.0:1789120975.135728:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+62:11700:x1876028947501440:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120975.135748:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120975.135771:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fce9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb91 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.135858:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fcf0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.135871:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fcf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.135898:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fcf0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.136048:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f11a00/0xb74d2367a830fce9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb91 expref: 64 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.136067:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fcf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb91 expref: 63 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.136076:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:3.0:1789120975.136079:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789120975.136083:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f10e00, rc 0) 00000100:00100000:3.0:1789120975.136147:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+63:11700:x1876028947501440:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 431us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120975.136154:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 130 00000100:00100000:2.0:1789120975.140733:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120975.141179:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947501696 00000100:00100000:1.0:1789120975.141189:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947501696 00000100:00100000:1.0:1789120975.141250:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 131 00000100:00100000:1.0:1789120975.141259:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+63:11700:x1876028947501696:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789120975.141339:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.141378:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.141390:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789120975.141568:0:9342:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1789120975.141579:0:9342:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 425330757269ns, next at 426330754552ns, rc = 0 00000004:00010000:1.0:1789120975.141632:0:9342:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f162d3ea reply state 0000000079adae31 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.141646:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.141654:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:1.0:1789120975.141658:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1789120975.141663:0:9342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120975.141775:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7170c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+65:11700:x1876028947501696:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 515us (1051us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789120975.141783:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 131 00000100:00100000:0.0:1789120975.151589:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.151752:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947501824 00000100:00100000:2.0:1789120975.151762:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947501824 00000100:00100000:2.0:1789120975.151862:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 132 00000100:00100000:2.0:1789120975.151874:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+65:11700:x1876028947501824:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120975.151899:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120975.151920:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcfe lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb98 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.151991:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcfe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb98 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.152007:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcfe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb98 expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.152026:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:2.0:1789120975.152030:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120975.152033:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946887082600, rc 0) 00000100:00100000:2.0:1789120975.152104:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:11700:x1876028947501824:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 232us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120975.152112:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 132 00000100:00100000:2.0:1789120975.157609:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120975.157740:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947501952 00000100:00100000:0.0:1789120975.157757:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947501952 00000100:00080000:3.0:1789120975.158001:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120975.158196:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:0.0:1789120975.158208:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947501952:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789120975.158448:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf714000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2412:x1876028947501952:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 242us (848us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789120975.158457:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:2.0:1789120975.167365:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120975.169560:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947502208 00000100:00100000:3.0:1789120975.169576:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947502208 00000100:00100000:3.0:1789120975.169723:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:3.0:1789120975.169735:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:11700:x1876028947502208:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789120975.170279:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:11700:x1876028947502208:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 544us (2921us total) trans 4294967402 rc 0/0 00000100:00100000:3.0:1789120975.170288:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:2.0:1789120975.178958:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120975.179100:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947502464 00000100:00100000:3.0:1789120975.179109:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947502464 00000100:00100000:3.0:1789120975.179173:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 133 00000100:00100000:3.0:1789120975.179200:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:11700:x1876028947502464:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789120975.179315:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf714f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:11700:x1876028947502464:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 117us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120975.179323:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 133 00000100:00100000:0.0:1789120975.183719:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120975.183871:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947502592 00000100:00100000:1.0:1789120975.183881:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947502592 00000100:00100000:1.0:1789120975.183957:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:1.0:1789120975.183968:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:11700:x1876028947502592:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120975.183992:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120975.184015:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830fd05 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eb9f expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.184120:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd0c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.184135:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.184147:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120975.184192:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789120975.184211:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd0c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.184237:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a830fd05 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb9f expref: 69 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.184255:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd0c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb9f expref: 68 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.184263:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:1.0:1789120975.184265:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789120975.184269:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3000, rc 0) 00000100:00100000:1.0:1789120975.184324:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+68:11700:x1876028947502592:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 358us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120975.184331:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:0.0:1789120975.197618:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120975.197749:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947502720 00000100:00100000:3.0:1789120975.197759:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947502720 00000100:00100000:3.0:1789120975.197854:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:3.0:1789120975.197866:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2411:x1876028947502720:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120975.197885:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120975.197905:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038c5adaf/0xb74d2367a830fd13 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eba6 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120975.197932:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3d1ce, blocks: 0x0 00010000:00010000:3.0:1789120975.197965:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1789120975.197970:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120975.197980:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038c5adaf/0xb74d2367a830fd13 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eba6 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.198001:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038c5adaf/0xb74d2367a830fd13 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eba6 expref: 10 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.198016:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f11a00, rc 0) 00000100:00100000:3.0:1789120975.198088:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:2411:x1876028947502720:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 224us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120975.198095:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:0.0:1789120975.204970:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120975.205091:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947502976 00000100:00100000:1.0:1789120975.205101:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947502976 00000100:00100000:1.0:1789120975.205169:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 135 00000100:00100000:1.0:1789120975.205195:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+68:11700:x1876028947502976:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789120975.205321:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+68:11700:x1876028947502976:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 127us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120975.205328:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 135 00000100:00100000:2.0:1789120975.221626:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120975.221894:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947503104 00000100:00100000:3.0:1789120975.221910:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947503104 00000100:00100000:3.0:1789120975.222007:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:3.0:1789120975.222018:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:11700:x1876028947503104:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120975.222046:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120975.222076:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebad expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.222310:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038c5adaf/0xb74d2367a830fd13 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eba6 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.222321:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120975.222326:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120975.222332:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 11 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.222377:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038c5adaf/0xb74d2367a830fd13 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eba6 expref: 11 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.222395:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038c5adaf/0xb74d2367a830fd13 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eba6 expref: 11 pid: 8435 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120975.222414:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914830c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876028970651264:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120975.222585:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030840 going to sleep for 11 seconds 00000100:00100000:0.0:1789120975.231181:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120975.231586:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947503232 00000100:00100000:1.0:1789120975.231601:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947503232 00010000:00010000:1.0:1789120975.231656:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038c5adaf/0xb74d2367a830fd13 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eba6 expref: 12 pid: 8435 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120975.231923:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914830c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876028970651264:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120975.231976:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 3/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 12 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.232018:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468a2f11000, rc 0) 00000100:00100000:3.0:1789120975.232105:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7152c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:11700:x1876028947503104:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 10088us (10490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120975.232115:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:1.0:1789120975.233630:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:1.0:1789120975.233652:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:2412:x1876028947503232:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120975.233673:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120975.233699:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038c5adaf/0xb74d2367a830fd13 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eba6 expref: 11 pid: 8435 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.233717:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038c5adaf/0xb74d2367a830fd13 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eba6 expref: 11 pid: 8435 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.233744:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038c5adaf/0xb74d2367a830fd13 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eba6 expref: 11 pid: 8435 timeout: 525 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.233762:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120975.233767:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789120975.233775:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.233817:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.233888:0:10341:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 10 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120975.233906:0:10341:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1876028970651392:192.168.202.32@tcp:105: 00000100:00100000:1.0:1789120975.234023:0:10341:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789120975.250294:0:10341:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:10341:1876028970651392:192.168.202.32@tcp:105: 00010000:00010000:3.0:1789120975.250338:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120975.250423:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120975.250439:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a1680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:2412:x1876028947503232:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 16792us (19269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120975.250456:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 86 00000100:00100000:0.0:1789120975.250481:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970651520:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120975.250558:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120975.250611:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947503360 00000100:00100000:1.0:1789120975.250619:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947503360 00000100:00100000:0.0:1789120975.250638:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970651648:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120975.250676:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00100000:1.0:1789120975.250677:0:8439:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9468914de940 x1876028947503360/t0(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:506/0 lens 504/0 e 0 to 0 dl 1789120986 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120975.250693:0:8439:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468914de940 with x1876028947503360 ext(0->12) 00002000:00010000:1.0:1789120975.250701:0:8439:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468914de940 00000100:00100000:0.0:1789120975.250725:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970651520 00000100:00100000:0.0:1789120975.250734:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970651520 00000100:00100000:1.0:1789120975.250741:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:1.0:1789120975.250757:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:2410:x1876028947503360:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789120975.250800:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970651648 00000100:00100000:0.0:1789120975.250806:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970651648 00000100:00100000:0.0:1789120975.250883:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789120975.251116:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970651520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789120975.251158:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789120975.251285:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970651520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120975.251343:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789120975.251354:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970651648:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120975.251377:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789120975.251400:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1789120975.251424:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970651648:12345-0@lo:41:osp-pre-0-1.0 Request processed in 71us (751us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120975.251433:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789120975.251454:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dcf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970651648:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789120975.251609:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970651520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120975.259444:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:2410:x1876028947503360:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 Request processed in 8680us (9018us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789120975.259465:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00002000:00100000:2.0:1789120975.259477:0:8439:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9468914de940 x1876028947503360/t4294967309(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:506/0 lens 504/448 e 0 to 0 dl 1789120986 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789120975.259489:0:8439:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468914de940 with x1876028947503360 ext(0->12) 00002000:00010000:2.0:1789120975.259497:0:8439:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468914de940 00000100:00100000:1.0:1789120975.263873:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.263977:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947503488 00000100:00100000:2.0:1789120975.263988:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947503488 00000100:00100000:2.0:1789120975.264053:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 136 00000100:00100000:2.0:1789120975.264064:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+68:11700:x1876028947503488:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789120975.267325:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:0.0:1789120975.267364:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789120975.267427:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1789120975.267453:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9468c1b3a840 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1789120975.267459:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9468c0866300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9468c1b3ae40 00000020:00080000:0.0:1789120975.267464:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9468c0866600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9467838cc400 00000004:00080000:0.0:1789120975.267498:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1789120975.267533:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94688357bc00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1789120975.267538:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9468b9bb3b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94688357b000 00000020:00080000:0.0:1789120975.267542:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9468b9bb3a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff946783b9dc00 00000100:00100000:0.0:1789120975.267693:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120975.267721:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970651776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789120975.267763:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:11700:x1876028947503488:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 Request processed in 3689us (3933us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120975.267777:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 136 00000100:00100000:0.0:1789120975.267865:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789120975.268533:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789120975.268605:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789120975.268629:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970651776 00000100:00100000:3.0:1789120975.268636:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970651776 00000100:00100000:3.0:1789120975.268694:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789120975.268706:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1876028970651776:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789120975.268738:0:8435:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00002000:00010000:3.0:1789120975.268796:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6aa3d1cd, atime: 0x6aa3d1cd, ctime: 0x6aa3d1cd, blocks: 0x8 00010000:00010000:3.0:1789120975.268805:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038c5adaf/0xb74d2367a830fd21 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.268876:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=425s v=(0 0) 00010000:00010000:3.0:1789120975.268883:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120975.268892:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038c5adaf/0xb74d2367a830fd21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.268913:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038c5adaf/0xb74d2367a830fd21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.268926:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038c5adaf/0xb74d2367a830fd21 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.268936:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038c5adaf/0xb74d2367a830fd21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.268969:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789120975.269150:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3644:x1876028970651776:12345-0@lo:6:osp-syn-1-0.0 Request processed in 446us (1286us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789120975.269159:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00010000:3.0:1789120975.269192:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120975.269201:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038c5adaf/0xb74d2367a830fd21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.269211:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789120975.269217:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038c5adaf/0xb74d2367a830fd21 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120975.269232:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970652032:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789120975.269247:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038c5adaf/0xb74d2367a830fd21 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.269274:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038c5adaf/0xb74d2367a830fd21 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.269283:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038c5adaf/0xb74d2367a830fd21 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.269311:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120975.269317:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120975.269318:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789120975.269323:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789120975.269377:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9467849a03c0/2, rc 0, transno 4294967305 00000100:00100000:2.0:1789120975.269380:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120975.269390:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970651776:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789120975.269472:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970651904:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789120975.269499:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120975.269544:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970652032 00000100:00100000:2.0:1789120975.269552:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970652032 00000100:00100000:3.0:1789120975.269684:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970651904 00000100:00100000:3.0:1789120975.269692:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970651904 00000100:00100000:2.0:1789120975.269709:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789120975.269723:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf716d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3647:x1876028970652032:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789120975.270251:0:9116:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789120975.270255:0:9116:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789120974 00002000:00010000:2.0:1789120975.270258:0:9116:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789120975.270260:0:9116:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789120974 -> 1789120974 00002000:00010000:2.0:1789120975.270263:0:9116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789120975.270322:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf716d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3647:x1876028970652032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 602us (1010us total) trans 4294967310 rc 0/0 00000004:00080000:0.0:1789120975.271414:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946783f9c780/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789120975.271428:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970652032:0@lo:2:osp-syn-0-0.0 00010000:00010000:1.0:1789120975.276783:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.276807:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.276815:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.276877:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120975.276883:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.276892:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.276914:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9468c1bd2600) 00010000:00010000:1.0:1789120975.276917:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120975.276923:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.276931:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a830fa1f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.276980:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.276987:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.276994:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.276999:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217de00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120975.277002:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277008:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277032:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff946888819400) 00010000:00010000:1.0:1789120975.277034:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120975.277038:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277044:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a830fac7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277064:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277070:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277076:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277082:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120975.277085:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277091:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277099:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff946888819900) 00010000:00010000:1.0:1789120975.277101:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120975.277105:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277110:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fb45 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277135:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277142:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277147:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277153:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120975.277156:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277162:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277170:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff946888819900) 00010000:00010000:1.0:1789120975.277172:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120975.277175:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277182:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a830fb68 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277198:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277205:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277210:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277221:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120975.277225:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277231:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277239:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:1.0:1789120975.277241:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120975.277244:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277250:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a830fc3a lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277262:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277268:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277275:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277279:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120975.277282:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277288:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277307:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:1.0:1789120975.277309:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789120975.277313:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.277319:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fcf7 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120975.277903:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789120975.277925:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1876028970651904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789120975.277985:0:8433:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00010000:00010000:3.0:1789120975.278018:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.278043:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eddf95e5/0xb74d2367a830fad5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb05 expref: 11 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.278067:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789120975.278073:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120975.278079:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.278127:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eddf95e5/0xb74d2367a830fad5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb05 expref: 11 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.278144:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eddf95e5/0xb74d2367a830fad5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb05 expref: 11 pid: 9116 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120975.278162:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876028970652160:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120975.278278:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030840 going to sleep for 11 seconds 00000100:00100000:3.0:1789120975.278357:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.279869:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789120975.279916:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947503616 00000100:00100000:2.0:1789120975.279926:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947503616 00000100:00100000:2.0:1789120975.279983:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:2.0:1789120975.279994:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:2411:x1876028947503616:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 00000100:00080000:2.0:1789120975.280084:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789120975.282045:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120975.282083:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947503744 00000100:00100000:1.0:1789120975.282103:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947503744 00010000:00010000:1.0:1789120975.282158:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eddf95e5/0xb74d2367a830fad5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb05 expref: 13 pid: 9116 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120975.282207:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 87 00000100:00100000:1.0:1789120975.282218:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:2411:x1876028947503744:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120975.282239:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120975.282246:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eddf95e5/0xb74d2367a830fad5 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb05 expref: 13 pid: 9116 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.282262:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eddf95e5/0xb74d2367a830fad5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb05 expref: 13 pid: 9116 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.282297:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120975.282303:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789120975.282310:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.282346:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.282374:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120975.282440:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:2411:x1876028947503744:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 223us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120975.282449:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 87 00010000:00010000:2.0:1789120975.285920:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eddf95e5/0xb74d2367a830fad5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb05 expref: 12 pid: 9116 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120975.285952:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876028970652160:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120975.285982:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.285995:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.286002:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.286035:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.286043:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.286081:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789120975.286308:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7161c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3647:x1876028970651904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8391us (16806us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789120975.286318:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:2.0:1789120975.286370:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9468914830c0/2, rc 0, transno 4294967311 00000100:00100000:2.0:1789120975.286376:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914830c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970651904:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789120975.286513:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120975.286520:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.286529:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217cc00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789120975.286534:0:8450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.286544:0:8450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.286565:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.286573:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000161e145f/0xb74d2367a830fd28 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.286595:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120975.286605:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120975.286606:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789120975.288382:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789120975.288406:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1789120975.289720:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f5a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947503616:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 Request processed in 9716us (11351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120975.289734:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:1.0:1789120975.294737:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.294816:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947504000 00000100:00100000:2.0:1789120975.294882:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947504000 00000100:00100000:2.0:1789120975.294958:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 137 00000100:00100000:2.0:1789120975.294970:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:11700:x1876028947504000:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789120975.295027:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120975.295060:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd0c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb9f expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.295086:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:2.0:1789120975.295118:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120975.295150:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.295163:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.295173:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120975.295295:0:6518:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000027d5f0b1 reply state 000000000b17cea3 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.295308:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.295315:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:2.0:1789120975.295317:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789120975.295320:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120975.295616:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:11700:x1876028947504000:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 646us (893us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1789120975.295625:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 137 00000100:00100000:0.0:1789120975.301674:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.301786:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947504128 00000100:00100000:2.0:1789120975.301795:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947504128 00000100:00100000:2.0:1789120975.301909:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:2.0:1789120975.301920:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947504128:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789120975.302094:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1789120975.302098:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 1789120974 -> 1789120974 00002000:00010000:2.0:1789120975.302100:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789120973 00002000:00010000:2.0:1789120975.302102:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 1789120974 -> 1789120974 00002000:00010000:2.0:1789120975.302121:0:8435:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789120975.302185:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947504128:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 266us (522us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1789120975.302194:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:3.0:1789120975.310808:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.310964:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947504384 00000100:00100000:2.0:1789120975.310978:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947504384 00000100:00100000:2.0:1789120975.311064:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 138 00000100:00100000:2.0:1789120975.311076:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:11700:x1876028947504384:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789120975.311161:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.311179:0:11088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fcf0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb91 expref: 17 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.311191:0:11088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.311228:0:11088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fcf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb91 expref: 17 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.311243:0:11088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fcf0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb91 expref: 17 pid: 11088 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120975.311257:0:11088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf714b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970652288:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120975.311348:0:11088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7780 going to sleep for 11 seconds 00000100:00100000:2.0:1789120975.316599:0:11088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf714b40 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970652288:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120975.316628:0:11088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120975.318062:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120975.318173:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947504512 00000100:00100000:0.0:1789120975.318184:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947504512 00010000:00010000:0.0:1789120975.318235:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fcf0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb91 expref: 18 pid: 11088 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120975.318286:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 88 00000100:00100000:0.0:1789120975.318298:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:2411:x1876028947504512:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120975.318314:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120975.318321:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fcf0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb91 expref: 18 pid: 11088 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.318352:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fcf0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb91 expref: 18 pid: 11088 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.318376:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10e00/0xb74d2367a830fcf0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb91 expref: 18 pid: 11088 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.318405:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:0.0:1789120975.318411:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.318420:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.318428:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.318458:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120975.318533:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835e9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:2411:x1876028947504512:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 236us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120975.318541:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 88 00010000:00010000:3.0:1789120975.318975:0:11088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.318990:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.319047:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.319078:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.319093:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.319102:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887083600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120975.319107:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.319115:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.319132:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:3.0:1789120975.319135:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789120975.319141:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.319147:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887083600/0xb74d2367a830fd36 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120975.319331:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:11700:x1876028947504384:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 Request processed in 8252us (8534us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789120975.319344:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 138 00000100:00100000:3.0:1789120975.325958:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.326059:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947504640 00000100:00100000:2.0:1789120975.326073:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947504640 00000100:00100000:2.0:1789120975.326161:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:2.0:1789120975.326171:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947504640:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789120975.326217:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.326236:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.326246:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120975.326250:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120975.326255:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 4/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.326290:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 7 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.326304:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 7 pid: 8433 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120975.326319:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf714b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876028970652416:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120975.326618:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789120975.336523:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.336705:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf714b40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8433:1876028970652416:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120975.336733:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 3/1,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120975.336959:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947504768 00000100:00100000:3.0:1789120975.336966:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947504768 00010000:00010000:3.0:1789120975.337005:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 8 pid: 8433 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120975.337046:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 89 00000100:00100000:3.0:1789120975.337055:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2411:x1876028947504768:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120975.337080:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120975.337105:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 8 pid: 8433 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.337119:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 8 pid: 8433 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.337141:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000017ec46a9/0xb74d2367a830fd1a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebad expref: 8 pid: 8433 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.337158:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120975.337162:0:10341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120975.337168:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.337179:0:10341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.337209:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120975.337371:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947504768:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 316us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120975.337379:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 89 00010000:00010000:2.0:1789120975.337449:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.337458:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.337478:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.337487:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.337495:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.337502:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887083800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789120975.337506:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.337516:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.337528:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.337549:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040f37c16/0xb74d2367a830fd3d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120975.337596:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947504640:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 Request processed in 11426us (11660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120975.337604:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:2.0:1789120975.350263:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120975.350365:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947505024 00000100:00100000:0.0:1789120975.350375:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947505024 00000100:00100000:0.0:1789120975.350449:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 139 00000100:00100000:0.0:1789120975.350460:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:11700:x1876028947505024:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789120975.350558:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.350575:0:9342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fc33 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb59 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.350585:0:9342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.350621:0:9342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fc33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb59 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.350636:0:9342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fc33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb59 expref: 16 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120975.350651:0:9342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a1680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970652544:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120975.350745:0:9342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860da540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120975.353670:0:9342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a1680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970652544:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120975.353701:0:9342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120975.357221:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120975.357400:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947505152 00000100:00100000:1.0:1789120975.357410:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947505152 00010000:00010000:1.0:1789120975.357469:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fc33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb59 expref: 17 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120975.357522:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 90 00000100:00100000:1.0:1789120975.357533:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:2411:x1876028947505152:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120975.357550:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120975.357558:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fc33 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb59 expref: 17 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.357572:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fc33 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb59 expref: 17 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.357597:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0000/0xb74d2367a830fc33 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb59 expref: 17 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.357614:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:1.0:1789120975.357621:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fc95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb7c expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.357631:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.357638:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.357657:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.357692:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120975.357749:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf717480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:2411:x1876028947505152:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 218us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120975.357757:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 90 00010000:00010000:2.0:1789120975.357955:0:9342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.357965:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.358154:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.358167:0:9342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcfe lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb98 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.358175:0:9342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.358207:0:9342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcfe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb98 expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.358222:0:9342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcfe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb98 expref: 16 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120975.358252:0:9342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7143c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970652672:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120975.358315:0:9342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120975.361085:0:9342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7143c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970652672:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120975.361116:0:9342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120975.362685:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.362765:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947505280 00000100:00100000:2.0:1789120975.362779:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947505280 00010000:00010000:2.0:1789120975.362888:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcfe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb98 expref: 17 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120975.362929:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 91 00000100:00100000:2.0:1789120975.362949:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:2412:x1876028947505280:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120975.362967:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120975.362975:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcfe lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb98 expref: 17 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.362988:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcfe lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb98 expref: 17 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.363011:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082600/0xb74d2367a830fcfe lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb98 expref: 17 pid: 6518 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.363027:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:2.0:1789120975.363033:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.363041:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.363066:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.363102:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120975.363161:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:2412:x1876028947505280:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 222us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120975.363171:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 91 00010000:00010000:3.0:1789120975.363200:0:9342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120975.363213:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789120975.363522:0:9342:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:3.0:1789120975.363699:0:9342:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:3.0:1789120975.363746:0:9342:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:2.0:1789120975.366184:0:9342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf715a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9342:1876028970652800:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789120975.366260:0:9342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120975.366291:0:9342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789120975.366373:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970652800 00000100:00100000:0.0:1789120975.366381:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970652800 00000100:00100000:0.0:1789120975.366535:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1789120975.366557:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9342:x1876028970652800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789120975.366659:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7143c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9342:x1876028970652800:12345-0@lo:1000:mdt00_003.0 Request processed in 105us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120975.366668:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789120975.366742:0:9342:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789120975.366748:0:9342:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:2.0:1789120975.366767:0:9342:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946783f9c780, transno 4294967310 00000100:00100000:2.0:1789120975.366795:0:9342:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9468914830c0 x1876028970651904/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789120991 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120975.366843:0:9342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf715a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9342:1876028970652800:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789120975.366994:0:9342:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:2.0:1789120975.367060:0:9342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf715a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9342:1876028970652928:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789120975.367101:0:9342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120975.367126:0:9342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468812ed540 going to sleep for 11 seconds 00000100:00100000:1.0:1789120975.367262:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970652928 00000100:00100000:1.0:1789120975.367268:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970652928 00000100:00100000:1.0:1789120975.367306:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789120975.367314:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9342:x1876028970652928:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1789120975.367511:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:9342:x1876028970652928:12345-0@lo:1000:mdt00_003.0 Request processed in 197us (408us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789120975.367518:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789120975.368057:0:9342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf715a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9342:1876028970652928:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789120975.368112:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368123:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368143:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368149:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120975.368154:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368162:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368179:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:2.0:1789120975.368183:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120975.368187:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368194:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd4b lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368218:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368226:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368231:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368236:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217c000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120975.368240:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368256:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368266:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120975.368269:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120975.368276:0:9342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fc95 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb7c expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368287:0:9342:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fc95 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb7c expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368296:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fc95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb7c expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.368327:0:9342:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fc95 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb7c expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120975.368340:0:9342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970653056:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789120975.368637:0:9342:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030180 going to sleep for 11 seconds 00000100:00100000:1.0:1789120975.385429:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120975.386627:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947505408 00000100:00100000:0.0:1789120975.386639:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947505408 00000100:00100000:0.0:1789120975.386708:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:0.0:1789120975.386718:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:11699:x1876028947505408:12345-192.168.202.32@tcp:49:lfs.0 00000100:00100000:0.0:1789120975.386887:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:11699:x1876028947505408:12345-192.168.202.32@tcp:49:lfs.0 Request processed in 170us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120975.386896:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:2.0:1789120975.389747:0:9342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970653056:192.168.202.32@tcp:105: 00010000:00010000:2.0:1789120975.389780:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.389792:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a830fc8e lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.389979:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd52 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390009:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390022:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390034:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd52 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390041:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd52 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390047:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd52 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390052:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120975.390057:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd52 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390063:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd52 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390074:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120975.390077:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120975.390081:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd52 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390100:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fd52 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390110:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390123:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390130:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390135:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120975.390138:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390145:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390168:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120975.390171:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789120975.390174:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120975.390181:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd44 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120975.390376:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf714b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:11700:x1876028947505024:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 39916us (40121us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789120975.390399:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 139 00000020:00080000:2.0:1789120975.390406:0:9342:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1789120975.393913:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000040:00080000:1.0:1789120975.394144:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120975.394149:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789120975.394743:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789120975.394754:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789120975.395190:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947505664 00000100:00100000:2.0:1789120975.395201:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947505664 00000100:00100000:2.0:1789120975.395259:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 140 00000100:00100000:2.0:1789120975.395269:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:11699:x1876028947505664:12345-192.168.202.32@tcp:58:lfs.0 00000040:00080000:2.0:1789120975.395496:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1789120975.395593:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:11699:x1876028947505664:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 324us (1689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120975.395602:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 140 00000100:00100000:3.0:1789120975.404672:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120975.405436:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947505920 00000100:00100000:0.0:1789120975.405559:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947505920 00000100:00100000:0.0:1789120975.405627:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:0.0:1789120975.405639:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:11700:x1876028947505920:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789120975.406261:0:6522:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789120975.406300:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1789120975.406337:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd59 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.406354:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.406367:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd59 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.406375:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd59 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.407604:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd59 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.407612:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.407715:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789120975.407866:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913fc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:11700:x1876028947505920:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 2225us (3201us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789120975.407876:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 32 00000020:00080000:0.0:1789120975.407882:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789120975.411565:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789120975.411580:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd59 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.411592:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789120975.411596:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd59 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.411607:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd59 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.411645:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:1.0:1789120975.411648:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789120975.411653:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd59 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.411660:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd59 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.415037:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120975.415044:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120975.415048:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120975.460930:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120975.462086:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947506048 00000100:00100000:0.0:1789120975.462104:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947506048 00000100:00100000:0.0:1789120975.462175:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 141 00000100:00100000:0.0:1789120975.462185:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:11702:x1876028947506048:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789120975.462212:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120975.462234:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830fd60 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebb4 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.462299:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830fd67 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.462314:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830fd67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.462324:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830fd67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.462353:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fd6e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.462360:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fd6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.462367:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fd6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.462446:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.462457:0:11088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb75 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.462466:0:11088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.462499:0:11088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb75 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.462513:0:11088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb75 expref: 22 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120975.462526:0:11088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a1680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970653184:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120975.462622:0:11088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468860da540 going to sleep for 11 seconds 00000100:00100000:0.0:1789120975.469039:0:11088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a1680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970653184:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120975.469074:0:11088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120975.474400:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120975.474514:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947506304 00000100:00100000:2.0:1789120975.474530:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947506304 00000100:00100000:2.0:1789120975.474609:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:2.0:1789120975.474621:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:6184:x1876028947506304:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789120975.474909:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:6184:x1876028947506304:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 289us (635us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1789120975.474918:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:3.0:1789120975.492212:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120975.492376:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947506432 00000100:00100000:1.0:1789120975.492401:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947506432 00010000:00010000:1.0:1789120975.492472:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb75 expref: 24 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120975.492523:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 92 00000100:00100000:1.0:1789120975.492534:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:2411:x1876028947506432:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120975.492549:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120975.492555:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb75 expref: 24 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.492568:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb75 expref: 24 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.492592:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082800/0xb74d2367a830fc80 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb75 expref: 24 pid: 6520 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.492609:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:1.0:1789120975.492617:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.492642:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.492651:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120975.492687:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120975.492754:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a6ad00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:2411:x1876028947506432:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 221us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120975.492763:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 92 00010000:00010000:0.0:1789120975.492975:0:11088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.492984:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120975.493043:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789120975.493048:0:11088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789120975.493069:0:11088:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493083:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493092:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830fd67 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493098:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830fd67 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493105:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830fd67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493112:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120975.493116:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830fd67 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493124:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830fd67 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493135:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:0.0:1789120975.493146:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120975.493151:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830fd67 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493157:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a830fd67 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493171:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fd6e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493178:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fd6e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493184:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fd6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493189:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120975.493192:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fd6e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493198:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fd6e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493206:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9468c1bfa300) 00010000:00010000:0.0:1789120975.493209:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120975.493212:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fd6e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493218:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830fd6e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493257:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830fd60 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebb4 expref: 23 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493284:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebb4 expref: 22 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120975.493291:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:0.0:1789120975.493294:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120975.493296:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22a00, rc 0) 00000100:00100000:0.0:1789120975.493332:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d19a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:11702:x1876028947506048:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 31148us (32417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120975.493341:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 141 00010000:00010000:0.0:1789120975.570403:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789120976.402846:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789120976.402857:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789120976.402886:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789120976.402892:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789120976.403077:0:14508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914ded00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970653312:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789120976.403295:0:14508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789120976.417478:0:14508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914ded00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970653312:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789120976.420844:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120976.420905:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947506560 00000100:00100000:2.0:1789120976.420917:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947506560 00000100:00080000:1.0:1789120976.421012:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120976.421030:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 142 00000100:00100000:2.0:1789120976.421049:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:11713:x1876028947506560:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789120976.421098:0:9342:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789120976.421269:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:11713:x1876028947506560:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 223us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120976.421279:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 142 00000100:00100000:3.0:1789120976.434480:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120976.434640:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947506816 00000100:00100000:0.0:1789120976.434653:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947506816 00000100:00100000:1.0:1789120976.437084:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 143 00000100:00100000:1.0:1789120976.437113:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:11713:x1876028947506816:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120976.437142:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120976.437170:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830fd7c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebbb expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120976.437306:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fd83 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120976.437353:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fd83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120976.437369:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fd83 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120976.437383:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789120976.437513:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830fd7c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebbb expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120976.437534:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fd83 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebbb expref: 24 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120976.437542:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:1.0:1789120976.437545:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120976.437549:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3600, rc 0) 00000100:00100000:1.0:1789120976.437641:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a6a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:11713:x1876028947506816:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 543us (3175us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789120976.437650:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 143 00000100:00100000:2.0:1789120976.450992:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120976.451117:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947507072 00000100:00100000:1.0:1789120976.451129:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947507072 00000100:00100000:1.0:1789120976.451216:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 144 00000100:00100000:1.0:1789120976.451230:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:11713:x1876028947507072:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789120976.451350:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd91 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120976.451351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00010000:00010000:1.0:1789120976.451372:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120976.451381:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947507200 00000100:00100000:2.0:1789120976.451385:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947507200 00010000:00010000:1.0:1789120976.451394:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120976.451423:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:2.0:1789120976.451431:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+25:2409:x1876028947507200:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120976.451453:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120976.451474:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830fd83 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebbb expref: 25 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120976.451493:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:2.0:1789120976.451498:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120976.451565:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+25:2409:x1876028947507200:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 136us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120976.451572:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00010000:00010000:1.0:1789120976.451581:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd91 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120976.451588:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd91 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120976.451595:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd91 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120976.451601:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120976.451606:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd91 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120976.451615:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd91 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120976.451623:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:1.0:1789120976.451626:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789120976.451630:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd91 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120976.451637:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830fd91 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120976.451736:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:11713:x1876028947507072:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 509us (759us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1789120976.451744:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 144 00000040:00080000:3.0:1789120976.453817:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120976.453848:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120976.454349:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1789120976.454365:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789120976.469101:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120976.469155:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947507456 00000100:00100000:2.0:1789120976.469166:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947507456 00000100:00100000:2.0:1789120976.469236:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:2.0:1789120976.469249:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:11713:x1876028947507456:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789120976.472547:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+25:11713:x1876028947507456:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 3285us (3445us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789120976.472562:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00000040:00080000:0.0:1789120976.559370:0:15025:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120976.559382:0:15025:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120976.559418:0:15025:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789120976.559425:0:15025:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789120976.598013:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120976.817104:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120976.817158:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947507712 00000100:00100000:0.0:1789120976.817171:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947507712 00000100:00100000:0.0:1789120976.817248:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:0.0:1789120976.817263:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+25:11726:x1876028947507712:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789120976.817297:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120976.817343:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd98 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebc2 expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120976.817508:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fd9f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120976.817536:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fd9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120976.817555:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fd9f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120976.817571:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789120976.817716:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a830fd98 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebc2 expref: 28 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120976.817737:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fd9f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebc2 expref: 27 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120976.817748:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:0.0:1789120976.817752:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789120976.817756:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22000, rc 0) 00000100:00100000:0.0:1789120976.817869:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:11726:x1876028947507712:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 610us (780us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789120976.817878:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:0.0:1789120976.830537:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120976.830696:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947507840 00000100:00100000:3.0:1789120976.830709:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947507840 00000100:00100000:3.0:1789120976.830789:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 146 00000100:00100000:3.0:1789120976.830802:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:11726:x1876028947507840:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:3.0:1789120976.830942:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120976.830965:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120976.830980:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120976.831037:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120976.831054:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120976.831061:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120976.831068:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120976.831074:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120976.831083:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120976.831099:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:3.0:1789120976.831103:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120976.831109:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120976.831116:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120976.831214:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:11726:x1876028947507840:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 414us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120976.831224:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 146 00000100:00100000:1.0:1789120976.999744:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120977.000054:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947507968 00000100:00100000:2.0:1789120977.000067:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947507968 00000100:00100000:2.0:1789120977.000289:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:2.0:1789120977.000303:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9e0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2409:x1876028947507968:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:2.0:1789120977.000629:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120977.000660:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a830fdb4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebc9 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120977.000696:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3d1ce, atime: 0x6aa3d1cd, ctime: 0x6aa3d1ce, blocks: 0x8 00010000:00010000:2.0:1789120977.000747:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=427s v=(0 0) 00010000:00010000:2.0:1789120977.000753:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120977.000765:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a830fdb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebc9 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120977.000789:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a830fdb4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebc9 expref: 7 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120977.000806:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0000, rc 0) 00000100:00100000:2.0:1789120977.001121:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9e0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2409:x1876028947507968:12345-192.168.202.32@tcp:101:cat.0 Request processed in 819us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120977.001131:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:0.0:1789120977.011522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120977.011642:0:8438:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947508096 00000100:00100000:3.0:1789120977.011656:0:8438:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947508096 00002000:00100000:3.0:1789120977.011787:0:8438:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9467849a30c0 x1876028947508096/t0(0) o3->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:508/0 lens 488/0 e 0 to 0 dl 1789120988 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789120977.011801:0:8438:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9467849a30c0 with x1876028947508096 ext(0->4095) 00002000:00010000:3.0:1789120977.011872:0:8438:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9467849a30c0 00000100:00100000:0.0:1789120977.012038:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789120977.012053:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2410:x1876028947508096:12345-192.168.202.32@tcp:3:cat.0 00000100:00100000:0.0:1789120977.012302:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a30c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2410:x1876028947508096:12345-192.168.202.32@tcp:3:cat.0 Request processed in 254us (793us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789120977.012311:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00002000:00100000:0.0:1789120977.012326:0:8440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->4095) req@ffff9467849a30c0 x1876028947508096/t0(0) o3->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:508/0 lens 488/4536 e 0 to 0 dl 1789120988 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120977.012335:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9467849a30c0 with x1876028947508096 ext(0->4095) 00002000:00010000:0.0:1789120977.012338:0:8440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9467849a30c0 00000100:00080000:1.0:1789120977.014545:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120977.298220:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120977.298262:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970653440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120977.298379:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120977.298486:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970653440 00000100:00100000:3.0:1789120977.298495:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970653440 00000100:00100000:3.0:1789120977.298562:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789120977.298574:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876028970653440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789120977.298614:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120977.298667:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a69e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3645:x1876028970653440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120977.298676:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1789120977.298748:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970653440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120977.299321:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970653696:0@lo:400:kworker.0 00000100:00100000:0.0:1789120977.299382:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120977.299408:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970654208:0@lo:400:kworker.0 00000100:00100000:0.0:1789120977.299433:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120977.299461:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970654720:0@lo:400:kworker.0 00000100:00100000:0.0:1789120977.299484:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120977.299507:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789120977.299512:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970653824:0@lo:400:kworker.0 00000100:00100000:0.0:1789120977.299541:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120977.299558:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970654336:0@lo:400:kworker.0 00000100:00100000:0.0:1789120977.299582:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120977.299600:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970654848:0@lo:400:kworker.0 00000100:00100000:0.0:1789120977.299622:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120977.299651:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970653696 00000100:00100000:0.0:1789120977.299657:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970653696 00000100:00100000:0.0:1789120977.299692:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970654208 00000100:00100000:0.0:1789120977.299706:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970654208 00000100:00100000:0.0:1789120977.299725:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970654720 00000100:00100000:0.0:1789120977.299728:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970654720 00000100:00100000:0.0:1789120977.299739:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970654336 00000100:00100000:0.0:1789120977.299742:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970654336 00000100:00100000:0.0:1789120977.299756:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970654848 00000100:00100000:0.0:1789120977.299758:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970654848 00000100:00100000:0.0:1789120977.299798:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789120977.299805:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf716d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970653696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120977.300495:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:3.0:1789120977.300508:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970654208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120977.301187:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf716d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970653696:12345-0@lo:400:kworker.0 Request processed in 1377us (1801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120977.301199:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1789120977.301228:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789120977.301239:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970654720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120977.301271:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf716940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970654720:12345-0@lo:400:kworker.0 Request processed in 35us (1786us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120977.301277:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000100:00100000:0.0:1789120977.301290:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1789120977.301296:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970654336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.301876:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970653952:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.301943:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120977.301988:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970654464:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.302018:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120977.302051:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970654976:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.302078:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120977.302107:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789120977.302114:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970653568:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.302149:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120977.302175:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970654080:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.302204:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120977.302225:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970654592:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.302248:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120977.302271:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970655104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120977.302298:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120977.302357:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970653824 00000100:00100000:1.0:1789120977.302365:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970653824 00000100:00100000:1.0:1789120977.302413:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970654080 00000100:00100000:1.0:1789120977.302416:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970654080 00000100:00100000:1.0:1789120977.302436:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789120977.302444:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970653824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.302494:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970653824:12345-0@lo:400:kworker.0 Request processed in 50us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120977.302501:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1789120977.302539:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789120977.302546:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970654080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.302587:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970654080:12345-0@lo:400:kworker.0 Request processed in 42us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120977.302594:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1789120977.302613:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970654464 00000100:00100000:1.0:1789120977.302616:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970654464 00000100:00100000:1.0:1789120977.302646:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970654976 00000100:00100000:1.0:1789120977.302648:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970654976 00000100:00100000:1.0:1789120977.302660:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970654592 00000100:00100000:1.0:1789120977.302662:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970654592 00000100:00100000:1.0:1789120977.302678:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789120977.302684:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970654464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.302730:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970654464:12345-0@lo:400:kworker.0 Request processed in 45us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120977.302737:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789120977.302748:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789120977.302754:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970654976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.302781:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970654976:12345-0@lo:400:kworker.0 Request processed in 27us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120977.302787:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789120977.302797:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789120977.302803:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1876028970654592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.302864:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3644:x1876028970654592:12345-0@lo:400:kworker.0 Request processed in 61us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120977.302871:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789120977.302892:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970653568 00000100:00100000:1.0:1789120977.302902:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970653568 00000100:00100000:1.0:1789120977.302944:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1789120977.302951:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970653568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.302983:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a48c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970653568:12345-0@lo:400:kworker.0 Request processed in 33us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120977.302989:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00000100:00100000:1.0:1789120977.303025:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970655104 00000100:00100000:1.0:1789120977.303029:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970655104 00000100:00100000:1.0:1789120977.303055:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789120977.303062:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876028970655104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120977.303087:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789120977.303116:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876028970655104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 55us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120977.303122:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:1.0:1789120977.303148:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120977.303154:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120977.303157:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120977.303160:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120977.303195:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970653568:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.303210:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970654080:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.303222:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783cfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970654592:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.303238:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970655104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120977.303249:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970654464:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.303259:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7152c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970654976:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.303327:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970653952 00000100:00100000:1.0:1789120977.303338:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970653952 00000100:00100000:1.0:1789120977.303362:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789120977.303369:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970654848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.303403:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970654848:12345-0@lo:400:kworker.0 Request processed in 35us (3780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120977.303410:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:1.0:1789120977.303422:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789120977.303428:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970653952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.303461:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970653952:12345-0@lo:400:kworker.0 Request processed in 33us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120977.303466:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1789120977.303496:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970653952:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.303533:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970653824:0@lo:400:kworker.0 00010000:00080000:1.0:1789120977.303550:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf714000 x1876028970654848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120977.303561:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf714000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970654848:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.303577:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970653696:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.303592:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970654208:0@lo:400:kworker.0 00000100:00100000:1.0:1789120977.303606:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970654720:0@lo:400:kworker.0 00000100:00100000:3.0:1789120977.304437:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7161c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970654208:12345-0@lo:400:kworker.0 Request processed in 3926us (4996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120977.304448:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1789120977.304801:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914d8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970654336:12345-0@lo:400:kworker.0 Request processed in 3503us (5216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120977.304810:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1789120977.307197:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789120977.307235:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970655232:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789120977.307335:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120977.309200:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970655232 00000100:00100000:3.0:1789120977.309219:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970655232 00000100:00100000:3.0:1789120977.309343:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789120977.309357:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970655232:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789120977.309394:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789120977.309495:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970655232:12345-0@lo:13:osp-pre-0-1.0 Request processed in 141us (2170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120977.309503:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789120977.310108:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970655232:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1789120977.314094:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467849a0780 x1876028970654336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789120977.314118:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970654336:0@lo:400:kworker.0 00000100:00100000:0.0:1789120977.362944:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120977.362988:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120977.363024:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120977.363051:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120977.363074:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120977.363108:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947508736 00000100:00100000:0.0:1789120977.363119:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947508736 00000100:00100000:0.0:1789120977.363188:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947508352 00000100:00100000:0.0:1789120977.363190:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947508352 00000100:00100000:0.0:1789120977.363204:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947508608 00000100:00100000:0.0:1789120977.363207:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947508608 00000100:00100000:0.0:1789120977.363224:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 344 00000100:00100000:0.0:1789120977.363234:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947508736:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120977.363363:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947508736:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 128us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120977.363372:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 344 00000100:00100000:0.0:1789120977.363391:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 345 00000100:00100000:0.0:1789120977.363398:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893846580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947508352:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120977.363422:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893846580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2411:x1876028947508352:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120977.363428:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 345 00000100:00100000:0.0:1789120977.363438:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 346 00000100:00100000:0.0:1789120977.363444:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947508608:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120977.363463:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2411:x1876028947508608:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 19us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120977.363468:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 346 00000100:00080000:0.0:1789120977.363483:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120977.363488:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789120977.363786:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947508480 00000100:00100000:3.0:1789120977.363791:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947508480 00000100:00100000:3.0:1789120977.364330:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:3.0:1789120977.364342:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947508480:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120977.364398:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914da1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947508480:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 60us (1409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120977.364406:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00080000:3.0:1789120977.364434:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120977.366602:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947508224 00000100:00100000:1.0:1789120977.366618:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947508224 00000100:00100000:1.0:1789120977.366694:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 456 00000100:00100000:1.0:1789120977.366704:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947508224:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120977.366801:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2411:x1876028947508224:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 99us (3882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120977.366809:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 456 00000040:00080000:3.0:1789120977.490280:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120977.490295:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120977.490330:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789120977.490343:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789120977.620442:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789120977.747527:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789120977.814453:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120977.814487:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970655360:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789120977.814596:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120977.814652:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970655360 00000100:00100000:3.0:1789120977.814662:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970655360 00000100:00100000:3.0:1789120977.814733:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789120977.814745:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970655360:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789120977.814776:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25562816 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120977.814929:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b38b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970655360:12345-0@lo:13:osp-pre-1-1.0 Request processed in 185us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120977.814938:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789120977.815061:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7021c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970655360:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789120978.642118:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120979.667267:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789120979.862390:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:0.0:1789120979.862410:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1789120980.370136:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120980.370163:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970655488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120980.370238:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120980.370313:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970655488 00000100:00100000:1.0:1789120980.370320:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970655488 00000100:00100000:1.0:1789120980.370367:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789120980.370376:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970655488:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789120980.370412:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1789120980.370460:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970655488:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120980.370467:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789120980.370515:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970655488:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120980.375444:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970655616:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120980.375517:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120980.375662:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970655616 00000100:00100000:3.0:1789120980.375670:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970655616 00000100:00100000:3.0:1789120980.375722:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789120980.375732:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970655616:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789120980.375769:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789120980.375843:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970655616:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120980.375862:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789120980.375960:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970655616:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789120980.690252:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789120980.885638:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1789120980.885678:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9467831f7780 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789120980.885699:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff946783ea1900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9467831f7f00 00000020:00080000:0.0:1789120980.885702:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff946783ea1b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff946782a8d800 00000020:00080000:0.0:1789120980.885736:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1789120980.885963:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1789120980.886061:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:2.0:1789120980.886473:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:2.0:1789120980.886482:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:3.0:1789120980.886556:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120980.886569:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120980.886576:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120980.886583:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887082c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120980.886588:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120980.886596:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120980.886615:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9468a3b96d00) 00010000:00010000:3.0:1789120980.886618:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120980.886623:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120980.886629:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946887082c00/0xb74d2367a830fd2f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120981.716932:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120982.419330:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789120982.419361:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970655744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120982.419449:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120982.420064:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970656000:0@lo:400:kworker.0 00000100:00100000:1.0:1789120982.420095:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970655744 00000100:00100000:0.0:1789120982.420109:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120982.420127:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970655744 00000100:00100000:0.0:1789120982.420134:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970656512:0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.420183:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120982.420218:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970657024:0@lo:400:kworker.0 00000100:00100000:1.0:1789120982.420236:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789120982.420250:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120982.420259:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970655744:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120982.420279:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789120982.420288:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970656128:0@lo:400:kworker.0 00002000:00000024:1.0:1789120982.420305:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789120982.420321:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120982.420344:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970656640:0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.420386:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120982.420403:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970655744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120982.420414:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789120982.420430:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970657152:0@lo:400:kworker.0 00000100:00080000:1.0:1789120982.420447:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120982.420465:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120982.420591:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970656000 00000100:00100000:0.0:1789120982.420597:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970656000 00000100:00100000:0.0:1789120982.420639:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970656512 00000100:00100000:0.0:1789120982.420641:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970656512 00000100:00100000:0.0:1789120982.420659:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970657024 00000100:00100000:0.0:1789120982.420661:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970657024 00000100:00100000:0.0:1789120982.420672:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970656640 00000100:00100000:0.0:1789120982.420681:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970656640 00000100:00100000:0.0:1789120982.420697:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789120982.420705:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970656000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.420754:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970656000:12345-0@lo:400:kworker.0 Request processed in 50us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.420761:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1789120982.420778:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789120982.420783:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970656512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.420841:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970656512:12345-0@lo:400:kworker.0 Request processed in 37us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.420848:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1789120982.420859:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789120982.420865:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970657024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.420903:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970657024:12345-0@lo:400:kworker.0 Request processed in 37us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.420908:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1789120982.420920:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789120982.420926:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970656640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.420950:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970656640:12345-0@lo:400:kworker.0 Request processed in 25us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.420956:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:0.0:1789120982.420981:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970656128 00000100:00100000:0.0:1789120982.420984:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970656128 00000100:00100000:0.0:1789120982.421008:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789120982.421014:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970656128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.421043:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970656128:12345-0@lo:400:kworker.0 Request processed in 30us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.421055:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789120982.421081:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970656256:0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.421108:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120982.421124:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970656768:0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.421146:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120982.421160:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970657280:0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.421179:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120982.421198:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1789120982.421205:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946782b91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970655872:0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.421230:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120982.421251:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970656384:0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.421272:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120982.421285:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970656896:0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.421303:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120982.421325:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970657152 00000100:00100000:0.0:1789120982.421329:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970657152 00000100:00100000:0.0:1789120982.421356:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970656768 00000100:00100000:0.0:1789120982.421358:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970656768 00000100:00100000:0.0:1789120982.421372:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970657280 00000100:00100000:0.0:1789120982.421375:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970657280 00000100:00100000:0.0:1789120982.421388:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789120982.421393:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970657152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.421424:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970657152:12345-0@lo:400:kworker.0 Request processed in 31us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.421430:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789120982.421450:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789120982.421457:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970656768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.421489:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a70c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970656768:12345-0@lo:400:kworker.0 Request processed in 32us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.421495:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789120982.421507:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789120982.421513:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970657280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.421538:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970657280:12345-0@lo:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.421544:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789120982.421569:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970656256 00000100:00100000:0.0:1789120982.421575:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970656256 00000100:00100000:0.0:1789120982.421598:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970656896 00000100:00100000:0.0:1789120982.421600:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970656896 00000100:00100000:2.0:1789120982.422186:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970657408:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789120982.422227:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120982.422266:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1789120982.422272:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9468914830c0, transno 4294967311 00000004:00080000:2.0:1789120982.422283:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1789120982.422319:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970655744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120982.422353:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970656768:0@lo:400:kworker.0 00000100:00100000:2.0:1789120982.422362:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1789120982.422367:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1789120982.422380:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9467849a03c0, transno 4294967305 00000100:00100000:2.0:1789120982.422389:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914f5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970657280:0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.423670:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789120982.423690:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970656256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.423780:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970656256:12345-0@lo:400:kworker.0 Request processed in 98us (2670us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.423787:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1789120982.423966:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:0.0:1789120982.423975:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970656896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120982.424009:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970656896:12345-0@lo:400:kworker.0 Request processed in 36us (2704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.424015:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1789120982.424768:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970656896:0@lo:400:kworker.0 00000100:00100000:3.0:1789120982.424783:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784894f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970656256:0@lo:400:kworker.0 00000100:00100000:3.0:1789120982.425960:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970657536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789120982.426058:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120982.426121:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970656128:0@lo:400:kworker.0 00010000:00080000:3.0:1789120982.426137:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784890000 x1876028970656640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120982.426148:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784890000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970656640:0@lo:400:kworker.0 00000100:00100000:3.0:1789120982.426160:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970657152:0@lo:400:kworker.0 00000100:00100000:3.0:1789120982.426171:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970656000:0@lo:400:kworker.0 00000100:00100000:3.0:1789120982.426182:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784895a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970656512:0@lo:400:kworker.0 00010000:00080000:3.0:1789120982.426193:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946891482d00 x1876028970657024/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789120998 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120982.426202:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946891482d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970657024:0@lo:400:kworker.0 00000100:00100000:1.0:1789120982.426739:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970657408 00000100:00100000:1.0:1789120982.426754:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970657408 00000100:00100000:1.0:1789120982.426968:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970657536 00000100:00100000:1.0:1789120982.426973:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970657536 00000100:00100000:1.0:1789120982.426994:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789120982.427004:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970657408:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789120982.427037:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789120982.427134:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970657408:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (4905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120982.427142:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789120982.427162:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789120982.427168:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970657536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120982.427191:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120982.430137:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a6bc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970657536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2952us (4063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120982.430156:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789120982.430226:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970655872 00000100:00100000:1.0:1789120982.430235:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970655872 00000100:00100000:1.0:1789120982.430292:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1789120982.430302:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970655872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120982.430379:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970655872:12345-0@lo:400:kworker.0 Request processed in 79us (9148us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120982.430386:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1789120982.430422:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970656384 00000100:00100000:1.0:1789120982.430426:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970656384 00000100:00100000:1.0:1789120982.430466:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789120982.430473:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970656384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120982.430508:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a6940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970656384:12345-0@lo:400:kworker.0 Request processed in 36us (9236us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120982.430514:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:1.0:1789120982.430540:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120982.430547:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789120982.430551:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789120982.430554:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120982.431254:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946782b91680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970655872:0@lo:400:kworker.0 00000100:00100000:3.0:1789120982.431275:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784896580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970656384:0@lo:400:kworker.0 00000100:00100000:3.0:1789120982.431343:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970657536:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120982.432953:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970657408:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120982.484131:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120982.484186:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120982.484226:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120982.484268:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120982.484289:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120982.484310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120982.484349:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947509120 00000100:00100000:0.0:1789120982.484349:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120982.484368:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947509120 00000100:00100000:0.0:1789120982.484390:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947509376 00000100:00100000:0.0:1789120982.484403:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947509376 00000100:00100000:3.0:1789120982.484471:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947509632 00000100:00100000:3.0:1789120982.484478:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947509632 00000100:00100000:0.0:1789120982.484491:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947509248 00000100:00100000:0.0:1789120982.484498:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947509248 00000100:00100000:3.0:1789120982.484510:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947508992 00000100:00100000:3.0:1789120982.484517:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947508992 00000100:00100000:3.0:1789120982.484551:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947509504 00000100:00100000:0.0:1789120982.484553:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:3.0:1789120982.484558:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947509504 00000100:00100000:0.0:1789120982.484573:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947509376:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120982.484592:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 353 00000100:00100000:3.0:1789120982.484617:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947509120:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120982.484663:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947509376:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 95us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.484676:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:3.0:1789120982.484691:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a52c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947509120:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 73us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120982.484702:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 353 00000100:00100000:0.0:1789120982.484710:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:0.0:1789120982.484729:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947509248:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120982.484736:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 354 00000100:00100000:3.0:1789120982.484748:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947509632:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120982.484779:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a5e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947509248:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 55us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.484787:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:3.0:1789120982.484808:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a61c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947509632:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 61us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120982.484858:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 354 00000100:00100000:3.0:1789120982.484891:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 355 00000100:00100000:3.0:1789120982.484899:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:2410:x1876028947508992:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120982.484925:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:2410:x1876028947508992:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120982.484967:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947508864 00000100:00100000:1.0:1789120982.484975:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947508864 00000100:00100000:1.0:1789120982.485013:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 458 00000100:00100000:1.0:1789120982.485020:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947508864:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120982.485056:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a4b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947508864:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 36us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120982.485063:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 458 00000100:00080000:2.0:1789120982.487963:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120982.487976:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120982.487980:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120982.487984:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789120982.488131:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 356 00000100:00100000:0.0:1789120982.488159:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947509504:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120982.488246:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947509504:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 102us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120982.488255:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 356 00000100:00100000:3.0:1789120982.492273:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 355 00010000:00010000:0.0:1789120982.747118:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120982.793089:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120982.793296:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947509760 00000100:00100000:2.0:1789120982.793305:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947509760 00000100:00100000:2.0:1789120982.793371:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 147 00000100:00100000:2.0:1789120982.793382:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:11378:x1876028947509760:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789120982.793497:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:11378:x1876028947509760:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 Request processed in 116us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120982.793505:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 147 00000100:00100000:0.0:1789120982.798112:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120982.798938:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947509888 00000100:00100000:2.0:1789120982.798949:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947509888 00000100:00100000:2.0:1789120982.799029:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 148 00000100:00100000:2.0:1789120982.799042:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:11378:x1876028947509888:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789120982.799237:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:11378:x1876028947509888:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 Request processed in 196us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120982.799245:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 148 00000100:00100000:1.0:1789120982.811308:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120982.811421:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947510144 00000100:00100000:0.0:1789120982.811431:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947510144 00000100:00100000:0.0:1789120982.811495:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:0.0:1789120982.811505:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:11378:x1876028947510144:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789120982.811760:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:11378:x1876028947510144:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 255us (461us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789120982.811768:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:2.0:1789120982.930289:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970657664:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789120982.930357:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120982.930495:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970657664 00000100:00100000:1.0:1789120982.930504:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970657664 00000100:00100000:1.0:1789120982.930558:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789120982.930567:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970657664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789120982.930590:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120982.930652:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970657664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 86us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120982.930660:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789120982.930953:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970657664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789120983.028023:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120983.028108:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947510272 00000100:00100000:3.0:1789120983.028126:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947510272 00000100:00100000:3.0:1789120983.028219:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 149 00000100:00100000:3.0:1789120983.028233:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:12183:x1876028947510272:12345-192.168.202.32@tcp:101:lsof.0 00010000:00010000:3.0:1789120983.028262:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120983.028292:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebd0 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120983.028379:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120983.028420:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120983.028438:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120983.028512:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789120983.028517:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120983.028569:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120983.028598:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fdbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd0 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120983.028620:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd0 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120983.028630:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:3.0:1789120983.028633:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120983.028637:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54400, rc 0) 00000100:00100000:3.0:1789120983.028721:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:12183:x1876028947510272:12345-192.168.202.32@tcp:101:lsof.0 Request processed in 491us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120983.028730:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 149 00010000:00010000:0.0:1789120983.763917:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120984.786415:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120985.490227:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789120985.490253:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf715a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970657792:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789120985.490326:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120985.492717:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970657792 00000100:00100000:0.0:1789120985.492732:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970657792 00000100:00100000:0.0:1789120985.492805:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1789120985.492815:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970657792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789120985.492879:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1789120985.492967:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970657792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 153us (2640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120985.492974:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789120985.493038:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120985.493054:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970657920:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789120985.493102:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120985.493211:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970657920 00000100:00100000:0.0:1789120985.493217:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970657920 00000100:00100000:0.0:1789120985.493249:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789120985.493257:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a089c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970657920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789120985.493276:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1789120985.493319:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a089c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970657920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120985.493326:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789120985.494275:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a6a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970657920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120985.494643:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf715a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970657792:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789120985.813116:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789120986.526292:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:0.0:1789120986.526323:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1789120986.526410:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1789120986.526422:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789120986.834066:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789120987.102134:0:15222:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 06:03:04 (1789120984) 00000100:00100000:3.0:1789120987.539672:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970658048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789120987.539754:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120987.540389:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970658432:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.540424:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120987.540443:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970658944:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.540465:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120987.540490:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970659456:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.540513:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120987.540533:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789120987.540539:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970658304:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.540568:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120987.540590:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970658816:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.540695:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120987.540714:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970659328:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.540737:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120987.540766:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970658432 00000100:00100000:3.0:1789120987.540773:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970658432 00000100:00100000:3.0:1789120987.540813:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970658944 00000100:00100000:3.0:1789120987.540816:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970658944 00000100:00100000:3.0:1789120987.540888:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970659456 00000100:00100000:3.0:1789120987.540891:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970659456 00000100:00100000:3.0:1789120987.540903:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970659328 00000100:00100000:3.0:1789120987.540905:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970659328 00000100:00100000:3.0:1789120987.540922:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789120987.540931:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970658432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120987.541205:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970658304 00000100:00100000:1.0:1789120987.541210:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970658304 00000100:00100000:1.0:1789120987.541241:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1789120987.541248:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970658304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120987.541304:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970658304:12345-0@lo:400:kworker.0 Request processed in 56us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120987.541312:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 459 00000100:00100000:1.0:1789120987.541349:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970658560:0@lo:400:kworker.0 00000100:00100000:1.0:1789120987.541375:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120987.541392:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970659072:0@lo:400:kworker.0 00000100:00100000:1.0:1789120987.541413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120987.541423:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970659584:0@lo:400:kworker.0 00000100:00100000:1.0:1789120987.541446:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120987.541465:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789120987.541470:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970658176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120987.541493:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120987.541525:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970658688:0@lo:400:kworker.0 00000100:00100000:1.0:1789120987.541552:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120987.541561:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970659200:0@lo:400:kworker.0 00000100:00100000:1.0:1789120987.541578:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120987.541591:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970659712:0@lo:400:kworker.0 00000100:00100000:1.0:1789120987.541607:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120987.541630:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970658048 00000100:00100000:1.0:1789120987.541634:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970658048 00000100:00100000:1.0:1789120987.541658:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970658176 00000100:00100000:1.0:1789120987.541660:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970658176 00000100:00100000:1.0:1789120987.541676:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789120987.541681:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970658048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789120987.541705:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789120987.541741:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a6a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970658048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (1988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120987.541747:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789120987.541758:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789120987.541764:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970658176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120987.541773:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789120987.541797:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7143c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970658176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 33us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120987.541803:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789120987.541883:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf716580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970658176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789120987.541901:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970658048:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789120987.541949:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970659072 00000100:00100000:1.0:1789120987.541959:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970659072 00000100:00100000:1.0:1789120987.542158:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970658688 00000100:00100000:1.0:1789120987.542162:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970658688 00000100:00100000:1.0:1789120987.542175:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789120987.542181:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970658944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120987.542216:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970658944:12345-0@lo:400:kworker.0 Request processed in 35us (1750us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120987.542222:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1789120987.542236:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:1.0:1789120987.542241:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783eca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970659456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542373:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970658432:12345-0@lo:400:kworker.0 Request processed in 1443us (1948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120987.542380:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1789120987.542396:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789120987.542409:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970659328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542442:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970659328:12345-0@lo:400:kworker.0 Request processed in 34us (1704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120987.542448:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1789120987.542462:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789120987.542467:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970659072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542500:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7152c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970659072:12345-0@lo:400:kworker.0 Request processed in 33us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120987.542506:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1789120987.542517:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789120987.542523:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970658688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542551:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cf8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970658688:12345-0@lo:400:kworker.0 Request processed in 28us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120987.542557:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1789120987.542586:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a69a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970658304:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542597:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a68f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970659328:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542607:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a683c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970658432:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542616:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a6b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970658944:0@lo:400:kworker.0 00010000:00080000:3.0:1789120987.542628:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784a69680 x1876028970659456/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120987.542638:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a69680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970659456:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542678:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970658816 00000100:00100000:3.0:1789120987.542682:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970658816 00000100:00100000:3.0:1789120987.542715:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970658560 00000100:00100000:3.0:1789120987.542718:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970658560 00000100:00100000:3.0:1789120987.542734:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789120987.542739:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970658816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542777:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970658816:12345-0@lo:400:kworker.0 Request processed in 38us (2081us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120987.542784:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789120987.542796:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789120987.542801:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970658560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542862:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf714000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970658560:12345-0@lo:400:kworker.0 Request processed in 61us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120987.542869:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789120987.542897:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a6b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970658816:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542928:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a68780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970658688:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.542939:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a68b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970658560:0@lo:400:kworker.0 00010000:00080000:3.0:1789120987.542949:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784a68000 x1876028970659072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120987.542957:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a68000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970659072:0@lo:400:kworker.0 00000100:00080000:2.0:1789120987.543192:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789120987.543197:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789120987.543200:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120987.543214:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970659840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120987.543246:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120987.543292:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970659840 00000100:00100000:2.0:1789120987.543297:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970659840 00000100:00100000:2.0:1789120987.543326:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789120987.543332:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970659840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789120987.543350:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789120987.543385:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970659840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120987.543391:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:2.0:1789120987.543406:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120987.543426:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970659840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120987.543550:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783eca1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970659456:12345-0@lo:400:kworker.0 Request processed in 26us (1753us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120987.543559:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1789120987.545183:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970659584 00000100:00100000:0.0:1789120987.545197:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970659584 00000100:00100000:0.0:1789120987.545283:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970659200 00000100:00100000:0.0:1789120987.545286:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970659200 00000100:00100000:0.0:1789120987.545300:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970659712 00000100:00100000:0.0:1789120987.545303:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970659712 00000100:00100000:0.0:1789120987.545316:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789120987.545323:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf715a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970659584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120987.545391:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf715a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970659584:12345-0@lo:400:kworker.0 Request processed in 68us (3944us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120987.545397:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1789120987.545413:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789120987.545419:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970659200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120987.545447:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfa580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970659200:12345-0@lo:400:kworker.0 Request processed in 28us (3868us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120987.545453:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789120987.545464:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789120987.545470:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970659712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120987.545499:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783cfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970659712:12345-0@lo:400:kworker.0 Request processed in 29us (3891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120987.545504:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1789120987.545934:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a6a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970659200:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.545948:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970659712:0@lo:400:kworker.0 00000100:00100000:3.0:1789120987.545958:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a6b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970659584:0@lo:400:kworker.0 00000100:00080000:2.0:1789120987.546371:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120987.600582:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120987.600642:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120987.600677:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120987.600709:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120987.600734:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120987.600752:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120987.600775:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120987.600805:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947510656 00000100:00100000:1.0:1789120987.600814:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947510656 00000100:00100000:1.0:1789120987.600916:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947511168 00000100:00100000:1.0:1789120987.600920:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947511168 00000100:00100000:1.0:1789120987.600934:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947510528 00000100:00100000:1.0:1789120987.600937:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947510528 00000100:00100000:1.0:1789120987.600948:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947511040 00000100:00100000:1.0:1789120987.600949:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947511040 00000100:00100000:1.0:1789120987.600964:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 363 00000100:00100000:1.0:1789120987.601000:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947510656:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120987.601072:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf716580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947510656:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 74us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120987.601079:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 363 00000100:00100000:1.0:1789120987.601097:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 364 00000100:00100000:1.0:1789120987.601104:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947511168:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120987.601130:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2409:x1876028947511168:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120987.601136:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 364 00000100:00100000:1.0:1789120987.601148:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 365 00000100:00100000:1.0:1789120987.601154:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:2409:x1876028947510528:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120987.601185:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:2409:x1876028947510528:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 31us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120987.601191:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 365 00000100:00100000:1.0:1789120987.601203:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 366 00000100:00100000:1.0:1789120987.601209:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2409:x1876028947511040:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120987.601232:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2409:x1876028947511040:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120987.601237:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 366 00000100:00080000:1.0:1789120987.601452:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789120987.601457:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789120987.601735:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947510912 00000100:00100000:0.0:1789120987.601741:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947510912 00000100:00100000:0.0:1789120987.601789:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947510784 00000100:00100000:0.0:1789120987.601792:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947510784 00000100:00100000:0.0:1789120987.601818:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 119 00000100:00100000:0.0:1789120987.601860:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947510912:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120987.601914:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a3c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2409:x1876028947510912:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 57us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120987.601921:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 119 00000100:00100000:0.0:1789120987.601943:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:0.0:1789120987.601951:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2409:x1876028947510784:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120987.601991:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2409:x1876028947510784:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 40us (1238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120987.601997:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:2.0:1789120987.602391:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947510400 00000100:00100000:2.0:1789120987.602396:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947510400 00000100:00100000:2.0:1789120987.602438:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 460 00000100:00100000:2.0:1789120987.602463:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2409:x1876028947510400:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120987.602501:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2409:x1876028947510400:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 49us (1930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120987.602507:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 460 00000100:00080000:1.0:1789120987.605393:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789120987.605404:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1789120987.730211:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120987.730226:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120987.730381:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1789120987.730392:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789120987.859734:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789120987.986553:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789120988.050784:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789120988.050853:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970659968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789120988.050931:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120988.051049:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970659968 00000100:00100000:3.0:1789120988.051064:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970659968 00000100:00100000:3.0:1789120988.051159:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789120988.051172:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970659968:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789120988.051208:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789120988.051301:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970659968:12345-0@lo:13:osp-pre-1-1.0 Request processed in 131us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120988.051309:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789120988.052180:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970659968:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789120988.762699:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120988.763064:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947511424 00000100:00100000:2.0:1789120988.763077:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947511424 00000100:00100000:2.0:1789120988.763160:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 150 00000100:00100000:2.0:1789120988.763172:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:12450:x1876028947511424:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120988.763200:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120988.763228:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdc9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebd7 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.763327:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdd0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.763346:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.763361:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.763915:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdd7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.763940:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.763953:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764085:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fdde lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764095:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fdde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764102:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fdde lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120988.764114:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1789120988.764206:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdd0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764215:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdd0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764222:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdd0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764228:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120988.764233:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdd0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764241:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdd0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764252:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9468c1bfa500) 00010000:00010000:2.0:1789120988.764255:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120988.764261:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdd0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764277:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdd0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764291:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdd7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764296:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdd7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764302:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764307:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120988.764310:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdd7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764316:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdd7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764323:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9468a3998e00) 00010000:00010000:2.0:1789120988.764325:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120988.764328:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdd7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764334:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdd7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.764988:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdc9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd7 expref: 16 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.765006:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fdde lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd7 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120988.765020:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:2.0:1789120988.765022:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120988.765025:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0400, rc 0) 00000100:00100000:2.0:1789120988.765101:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:12450:x1876028947511424:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1932us (2417us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789120988.765110:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 150 00000100:00100000:2.0:1789120988.777135:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120988.777228:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120988.777575:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947511552 00000100:00100000:0.0:1789120988.777584:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947511552 00000100:00100000:0.0:1789120988.777647:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 151 00000100:00100000:0.0:1789120988.777656:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:12450:x1876028947511552:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789120988.777762:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:12450:x1876028947511552:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 Request processed in 106us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120988.777770:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 151 00000100:00100000:1.0:1789120988.779953:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947511680 00000100:00100000:1.0:1789120988.779975:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947511680 00000100:00100000:1.0:1789120988.780045:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:1.0:1789120988.780053:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:2410:x1876028947511680:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120988.780068:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120988.780091:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fdde lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd7 expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120988.780111:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:1.0:1789120988.780115:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120988.780170:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:2410:x1876028947511680:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 117us (2941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120988.780177:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:2.0:1789120988.787501:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120988.787700:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947511808 00000100:00100000:3.0:1789120988.787709:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947511808 00000100:00100000:3.0:1789120988.787771:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 152 00000100:00100000:3.0:1789120988.787782:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:12450:x1876028947511808:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789120988.787931:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:12450:x1876028947511808:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 Request processed in 150us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120988.787940:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 152 00010000:00010000:3.0:1789120988.882309:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789120989.011280:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:0.0:1789120989.798559:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120989.799292:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120989.802426:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1789120989.802445:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789120989.906674:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120990.609924:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970660096:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120990.610580:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467849a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970660224:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120990.610651:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120990.610755:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120990.611049:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970660224 00000100:00100000:2.0:1789120990.611057:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970660224 00000100:00100000:2.0:1789120990.611163:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970660096 00000100:00100000:2.0:1789120990.611167:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970660096 00000100:00100000:2.0:1789120990.611181:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789120990.611303:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970660224:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789120990.611334:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:2.0:1789120990.611380:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fa580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970660224:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120990.611553:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:3.0:1789120990.613556:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467849a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970660224:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789120990.613677:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1789120990.613695:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970660096:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789120990.613730:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1789120990.613816:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970660096:12345-0@lo:41:osp-pre-1-0.0 Request processed in 130us (3061us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120990.613840:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789120990.613936:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970660096:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789120990.931085:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120991.033936:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.037074:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947511936 00000100:00100000:2.0:1789120991.037088:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947511936 00000100:00100000:2.0:1789120991.037167:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 153 00000100:00100000:2.0:1789120991.037178:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:12493:x1876028947511936:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789120991.037198:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120991.037220:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebde expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037301:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdf3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037316:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037328:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789120991.037345:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789120991.037345:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdfa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037356:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037363:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037407:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdf3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037414:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdf3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037420:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdf3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037426:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120991.037430:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdf3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037447:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdf3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037471:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:2.0:1789120991.037475:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120991.037480:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdf3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037487:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fdf3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037500:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdfa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037506:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdfa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037512:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037517:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120991.037520:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdfa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037526:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdfa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037532:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9468a3998700) 00010000:00010000:2.0:1789120991.037535:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120991.037537:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdfa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037553:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fdfa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037584:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebde expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037594:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:2.0:1789120991.037596:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120991.037600:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fdec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebde expref: 15 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.037609:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1e00, rc 0) 00000100:00100000:2.0:1789120991.037678:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:12493:x1876028947511936:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 502us (3751us total) trans 0 rc 301/301 00000100:00100000:2.0:1789120991.037686:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 153 00000100:00100000:3.0:1789120991.055858:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.055897:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947512192 00000100:00100000:2.0:1789120991.055906:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947512192 00000100:00100000:2.0:1789120991.055977:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 154 00000100:00100000:2.0:1789120991.055988:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+14:12493:x1876028947512192:12345-192.168.202.32@tcp:36:lfs.0 00010000:00010000:2.0:1789120991.056043:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120991.056073:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830f740 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea02 expref: 14 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.056092:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:2.0:1789120991.056097:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120991.056155:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.056177:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd0 expref: 5 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.056186:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.056219:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd0 expref: 5 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.056234:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd0 expref: 5 pid: 6519 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120991.056247:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1876028970660352:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120991.056341:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7000 going to sleep for 11 seconds 00000100:00100000:1.0:1789120991.069956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120991.069991:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947512320 00000100:00100000:1.0:1789120991.070000:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947512320 00010000:00010000:1.0:1789120991.070053:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd0 expref: 6 pid: 6519 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120991.070098:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 93 00000100:00100000:1.0:1789120991.070110:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947512320:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120991.070126:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120991.070133:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd0 expref: 6 pid: 6519 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120991.070147:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd0 expref: 6 pid: 6519 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120991.070171:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:1.0:1789120991.070177:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120991.070186:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120991.070194:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120991.070212:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120991.070261:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947512320:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 153us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120991.070269:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 93 00000100:00080000:1.0:1789120991.070322:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789120991.070991:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fdc2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebd0 expref: 5 pid: 6519 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120991.071020:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1876028970660352:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120991.071041:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071050:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071056:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071079:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071090:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071099:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071653:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071664:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071670:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120991.071685:0:6518:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008e44238f reply state 00000000b0158ce9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071708:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071714:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789120991.071716:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789120991.071720:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789120991.071726:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789120991.071735:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071741:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071747:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071753:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120991.071757:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071764:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071773:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468c0868f00) 00010000:00010000:3.0:1789120991.071775:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120991.071778:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071784:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fe01 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120991.071845:0:6518:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008e44238f reply state 00000000b0158ce9 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071855:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.071861:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9468886f6800) 00010000:00010000:3.0:1789120991.071863:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789120991.071865:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:3.0:1789120991.071942:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a6a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:12493:x1876028947512192:12345-192.168.202.32@tcp:36:lfs.0 Request processed in 15955us (16092us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789120991.071951:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 154 00000100:00100000:1.0:1789120991.168339:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.168482:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947512448 00000100:00100000:2.0:1789120991.168493:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947512448 00000100:00100000:2.0:1789120991.168603:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 155 00000100:00100000:2.0:1789120991.168615:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+15:12501:x1876028947512448:12345-192.168.202.32@tcp:101:lctl.0 00010000:00010000:2.0:1789120991.168642:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120991.168668:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830fe16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebe5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.169246:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fe1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.169262:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fe1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.169273:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fe1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120991.169320:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789120991.169324:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120991.169347:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fe1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.170257:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830fe16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebe5 expref: 17 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.170294:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fe1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebe5 expref: 16 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.170320:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468a3998700) 00010000:00010000:3.0:1789120991.170323:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120991.170328:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54400, rc 0) 00000100:00100000:3.0:1789120991.170598:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:12501:x1876028947512448:12345-192.168.202.32@tcp:101:lctl.0 Request processed in 1983us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120991.170609:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 155 00000100:00100000:1.0:1789120991.220350:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.220444:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947512576 00000100:00100000:2.0:1789120991.220452:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947512576 00000100:00100000:2.0:1789120991.220527:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 156 00000100:00100000:2.0:1789120991.220535:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+16:12507:x1876028947512576:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789120991.220571:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120991.220593:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fe24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebec expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220666:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fe2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220680:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fe2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220691:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fe2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220715:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220722:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220728:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220857:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830fe39 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220866:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830fe39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220873:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830fe39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120991.220910:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789120991.220919:0:11088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789120991.220939:0:11088:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830fe39 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220949:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fe2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220954:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fe2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220960:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fe2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220965:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120991.220970:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fe2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220977:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fe2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.220988:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468a3998700) 00010000:00010000:2.0:1789120991.220991:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120991.220996:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fe2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.221002:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fe2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.221016:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.221020:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.221032:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.221035:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120991.221037:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.221041:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.221046:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9468886f6800) 00010000:00010000:2.0:1789120991.221048:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120991.221050:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.221053:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.221072:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fe24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebec expref: 18 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.221080:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830fe39 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebec expref: 17 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.221085:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:2.0:1789120991.221086:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789120991.221088:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0600, rc 0) 00000100:00100000:2.0:1789120991.221154:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:12507:x1876028947512576:12345-192.168.202.32@tcp:101:bash.0 Request processed in 619us (811us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120991.221169:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 156 00000100:00100000:1.0:1789120991.223594:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120991.223670:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947512832 00000100:00100000:3.0:1789120991.223678:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947512832 00000100:00100000:3.0:1789120991.223722:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 157 00000100:00100000:3.0:1789120991.223729:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:12507:x1876028947512832:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789120991.223746:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120991.223763:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fe40 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebf3 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.223890:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe47 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.223901:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.223909:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224086:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224093:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224110:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789120991.224399:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789120991.224502:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a830fe55 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224508:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a830fe55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224513:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a830fe55 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224536:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe47 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224541:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe47 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224545:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224548:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120991.224551:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe47 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224556:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe47 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224564:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789120991.224566:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120991.224574:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe47 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224579:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe47 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120991.224588:0:6518:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000c078aa5e reply state 00000000719d379d transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224595:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224599:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468886f6200) 00010000:00010000:3.0:1789120991.224600:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789120991.224602:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789120991.224624:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fe40 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebf3 expref: 20 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224633:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a830fe55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebf3 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.224638:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6900) 00010000:00010000:3.0:1789120991.224639:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120991.224641:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54c00, rc 0) 00000100:00100000:3.0:1789120991.224730:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:12507:x1876028947512832:12345-192.168.202.32@tcp:101:bash.0 Request processed in 1001us (1144us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789120991.224736:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 157 00000100:00100000:1.0:1789120991.228383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120991.228499:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947512960 00000100:00100000:0.0:1789120991.228507:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947512960 00000100:00080000:1.0:1789120991.228559:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789120991.228625:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:0.0:1789120991.228634:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467849a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947512960:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120991.228650:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120991.228665:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a830fe63 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ebfa expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789120991.228685:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789120991.228702:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=441s v=(0 0) 00010000:00010000:0.0:1789120991.228707:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120991.228716:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a830fe63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebfa expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.228734:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a830fe63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebfa expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.228761:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22600, rc 0) 00000100:00100000:0.0:1789120991.228854:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467849a12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947512960:12345-192.168.202.32@tcp:101:bash.0 Request processed in 221us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120991.228862:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:1.0:1789120991.231500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120991.231584:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947513088 00000100:00100000:0.0:1789120991.231592:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947513088 00000100:00100000:0.0:1789120991.231653:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:0.0:1789120991.231677:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:12507:x1876028947513088:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120991.231694:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120991.231711:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec01 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.231742:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a830fe63 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebfa expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.231751:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120991.231755:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120991.231773:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.231818:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a830fe63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebfa expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.231858:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a830fe63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebfa expref: 7 pid: 8435 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120991.231871:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f83c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876028970660480:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120991.231971:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8840 going to sleep for 11 seconds 00000100:00100000:1.0:1789120991.235412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120991.236107:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f83c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876028970660480:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120991.236138:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.236175:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23800, rc 0) 00000100:00100000:0.0:1789120991.236231:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf717480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:12507:x1876028947513088:12345-192.168.202.32@tcp:101:bash.0 Request processed in 4556us (4741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120991.236239:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:2.0:1789120991.239314:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947513216 00000100:00100000:2.0:1789120991.239327:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947513216 00010000:00010000:2.0:1789120991.239387:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a830fe63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebfa expref: 7 pid: 8435 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120991.239494:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 94 00000100:00100000:2.0:1789120991.239505:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf661e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947513216:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120991.239521:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120991.239543:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a830fe63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebfa expref: 7 pid: 8435 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.239557:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a830fe63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebfa expref: 7 pid: 8435 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.239580:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a830fe63 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebfa expref: 7 pid: 8435 timeout: 541 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.239596:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120991.239601:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120991.239608:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.239618:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.239676:0:6503:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120991.239691:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1876028970660608:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789120991.239780:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789120991.244316:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.244434:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:6503:1876028970660608:192.168.202.32@tcp:105: 00010000:00010000:2.0:1789120991.244457:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120991.244523:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf661e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947513216:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 5019us (9120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120991.244535:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 94 00000100:00100000:3.0:1789120991.245728:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947513472 00000100:00100000:3.0:1789120991.245737:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947513472 00000100:00100000:3.0:1789120991.245846:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:3.0:1789120991.245855:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:12507:x1876028947513472:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:3.0:1789120991.246161:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:12507:x1876028947513472:12345-192.168.202.32@tcp:35:bash.0 Request processed in 305us (1856us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1789120991.246168:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:1.0:1789120991.377038:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120991.377282:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947513728 00000100:00100000:3.0:1789120991.377292:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947513728 00000100:00100000:3.0:1789120991.377348:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 158 00000100:00100000:3.0:1789120991.377357:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:12517:x1876028947513728:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120991.377387:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120991.377407:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fe71 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec08 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120991.377502:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1789120991.377606:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fe71 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec08 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.377618:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468a3998700) 00010000:00010000:3.0:1789120991.377620:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120991.377624:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fe71 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec08 expref: 23 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.377635:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55600, rc 0) 00000100:00100000:3.0:1789120991.377688:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:12517:x1876028947513728:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 331us (659us total) trans 4294967421 rc 301/301 00000100:00100000:3.0:1789120991.377703:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 158 00000100:00100000:1.0:1789120991.385710:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.386385:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947513984 00000100:00100000:2.0:1789120991.386397:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947513984 00000100:00100000:2.0:1789120991.386488:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:2.0:1789120991.386499:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:12517:x1876028947513984:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789120991.386737:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:12517:x1876028947513984:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 239us (1036us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1789120991.386745:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:0.0:1789120991.479391:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.479499:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947514112 00000100:00100000:2.0:1789120991.479519:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947514112 00000100:00100000:2.0:1789120991.479602:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 159 00000100:00100000:2.0:1789120991.479622:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:12523:x1876028947514112:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789120991.479652:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120991.479676:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fe7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec0f expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.479758:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe86 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.479773:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.479814:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120991.479886:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:2.0:1789120991.479890:0:11088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789120991.479919:0:11088:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe86 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.479944:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fe7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec0f expref: 25 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.479960:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe86 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec0f expref: 24 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.479969:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:2.0:1789120991.479972:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789120991.479975:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0c00, rc 0) 00000100:00100000:2.0:1789120991.480029:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:12523:x1876028947514112:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 410us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120991.480036:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 159 00000100:00100000:1.0:1789120991.488146:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120991.488250:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947514368 00000100:00100000:3.0:1789120991.488332:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947514368 00000100:00100000:3.0:1789120991.488440:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 160 00000100:00100000:3.0:1789120991.488451:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:12523:x1876028947514368:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120991.488473:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120991.488495:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fe8d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec16 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.488614:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe94 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.488629:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.488642:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe94 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120991.488653:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789120991.488887:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fe8d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec16 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.488906:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe94 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec16 expref: 26 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.488915:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6900) 00010000:00010000:3.0:1789120991.488917:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120991.488921:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54a00, rc 0) 00000100:00100000:3.0:1789120991.489118:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+26:12523:x1876028947514368:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 668us (982us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789120991.489126:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 160 00000100:00100000:1.0:1789120991.494505:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120991.494558:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120991.494633:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947514752 00000100:00100000:3.0:1789120991.494655:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947514752 00000100:00100000:3.0:1789120991.494715:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 161 00000100:00100000:3.0:1789120991.494726:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+26:12523:x1876028947514752:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120991.494750:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120991.494771:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830fea2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec1d expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.494925:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fea9 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.494951:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fea9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.494972:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fea9 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120991.494986:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789120991.495093:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830fea2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec1d expref: 29 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.495110:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fea9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec1d expref: 28 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.495118:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6900) 00010000:00010000:3.0:1789120991.495121:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789120991.495124:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55600, rc 0) 00000100:00100000:3.0:1789120991.495177:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+28:12523:x1876028947514752:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 452us (617us total) trans 4294967424 rc 0/0 00000100:00100000:3.0:1789120991.495184:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 161 00000100:00100000:2.0:1789120991.495681:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947514624 00000100:00100000:2.0:1789120991.495687:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947514624 00000100:00100000:2.0:1789120991.495740:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:2.0:1789120991.495748:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+28:2411:x1876028947514624:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120991.495758:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120991.495774:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a830fe94 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec16 expref: 28 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.495797:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6900) 00010000:00010000:2.0:1789120991.495801:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120991.495869:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:2411:x1876028947514624:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 121us (1372us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120991.495876:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:1.0:1789120991.503167:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.503290:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947514880 00000100:00100000:2.0:1789120991.503299:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947514880 00000100:00100000:2.0:1789120991.503362:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:2.0:1789120991.503372:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947514880:12345-192.168.202.32@tcp:1:lfs.0 00010000:00010000:2.0:1789120991.503415:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.503435:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.503443:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120991.503447:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120991.503452:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.503486:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.503516:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 6 pid: 8434 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120991.503531:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876028970660736:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120991.503664:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120991.509735:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120991.509866:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947515008 00000100:00100000:0.0:1789120991.509875:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947515008 00002000:00100000:0.0:1789120991.509926:0:8440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff946784a68000 x1876028947515008/t0(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:522/0 lens 504/0 e 0 to 0 dl 1789121002 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120991.509948:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff946784a68000 with x1876028947515008 ext(0->12) 00010000:00010000:0.0:1789120991.509964:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 7 pid: 8434 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.509981:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 7 pid: 8434 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789120991.509989:0:8440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946784a68000 00000100:00100000:0.0:1789120991.510021:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:0.0:1789120991.510031:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947515008:12345-192.168.202.32@tcp:4:lfs.0 00000100:00100000:2.0:1789120991.510488:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876028970660736:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120991.510511:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120991.511361:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a68000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2412:x1876028947515008:12345-192.168.202.32@tcp:4:lfs.0 Request processed in 1325us (1629us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789120991.511373:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00002000:00100000:0.0:1789120991.511383:0:8440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff946784a68000 x1876028947515008/t4294967306(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:522/0 lens 504/448 e 0 to 0 dl 1789121002 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120991.511407:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff946784a68000 with x1876028947515008 ext(0->12) 00010000:00010000:0.0:1789120991.511416:0:8440:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 9 pid: 8434 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.511430:0:8440:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 9 pid: 8434 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789120991.511436:0:8440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff946784a68000 00000100:00100000:1.0:1789120991.517406:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.517871:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947515136 00000100:00100000:2.0:1789120991.517880:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947515136 00010000:00010000:2.0:1789120991.517923:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 9 pid: 8434 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120991.518125:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 95 00000100:00100000:2.0:1789120991.518137:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2410:x1876028947515136:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120991.518154:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789120991.518173:0:6505:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789120991.518176:0:6505:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1789120990 00002000:00010000:2.0:1789120991.518178:0:6505:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1789120991 00002000:00010000:2.0:1789120991.518180:0:6505:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1789120990 00002000:00010000:2.0:1789120991.518182:0:6505:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789120991.518188:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 9 pid: 8434 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.518221:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 9 pid: 8434 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.518244:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004753afee/0xb74d2367a830fe6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec01 expref: 9 pid: 8434 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.518435:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120991.518441:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120991.518447:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.518459:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.518498:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120991.518610:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2410:x1876028947515136:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 475us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120991.518619:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 95 00010000:00010000:0.0:1789120991.518708:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.518719:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.518739:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.518749:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.518757:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.518764:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789120991.518769:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.518796:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.518811:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.518871:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c28ac653/0xb74d2367a830feb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120991.518922:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947514880:12345-192.168.202.32@tcp:1:lfs.0 Request processed in 15552us (15865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120991.518931:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:1.0:1789120991.522178:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120991.522339:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947515392 00000100:00100000:3.0:1789120991.522348:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947515392 00000100:00100000:3.0:1789120991.522433:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:3.0:1789120991.522444:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12523:x1876028947515392:12345-192.168.202.32@tcp:35:lfs.0 00000004:00010000:3.0:1789120991.522505:0:6521:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fea9 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec1d expref: 27 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789120991.522718:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:3.0:1789120991.522752:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1789120991.523492:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:3.0:1789120991.523532:0:6521:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.523548:0:6521:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a830fe55 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebf3 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.523558:0:6521:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.523591:0:6521:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a830fe55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebf3 expref: 31 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.523605:0:6521:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a830fe55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebf3 expref: 31 pid: 6518 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120991.523618:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a68b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1876028970660864:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120991.523711:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a180 going to sleep for 11 seconds 00000100:00100000:2.0:1789120991.528194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120991.528589:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a68b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6521:1876028970660864:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120991.528632:0:6521:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120991.531384:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947515520 00000100:00100000:0.0:1789120991.531398:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947515520 00010000:00010000:0.0:1789120991.531450:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a830fe55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebf3 expref: 32 pid: 6518 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120991.531561:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00100000:0.0:1789120991.531572:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:2411:x1876028947515520:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120991.531587:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120991.531595:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a830fe55 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebf3 expref: 32 pid: 6518 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.531609:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a830fe55 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebf3 expref: 32 pid: 6518 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.531656:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a830fe55 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebf3 expref: 32 pid: 6518 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.531676:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6900) 00010000:00010000:0.0:1789120991.531682:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.531691:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.531700:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.531739:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120991.531969:0:6521:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.531978:0:6521:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789120991.532089:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:3.0:1789120991.532213:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:3.0:1789120991.532321:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a68b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1876028970660992:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789120991.532489:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:2411:x1876028947515520:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 917us (4301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120991.532499:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 96 00000100:00100000:3.0:1789120991.532784:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120991.532848:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120991.533209:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970660992 00000100:00100000:1.0:1789120991.533216:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970660992 00000100:00080000:3.0:1789120991.533381:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120991.533572:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:1.0:1789120991.533583:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1876028970660992:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789120991.533678:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a68780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6521:x1876028970660992:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 98us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120991.533685:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789120991.534002:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a68b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1876028970660992:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789120991.534132:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:3.0:1789120991.534192:0:6521:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784a68b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1876028970661120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789120991.534227:0:6521:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120991.534251:0:6521:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789120991.534722:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970661120 00000100:00100000:1.0:1789120991.534728:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970661120 00000100:00100000:1.0:1789120991.534768:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1789120991.534776:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6521:x1876028970661120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789120991.535048:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a6b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6521:x1876028970661120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 159us (707us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789120991.535057:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789120991.535161:0:6521:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784a68b40 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6521:1876028970661120:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789120991.535207:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:3.0:1789120991.535243:0:6521:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.535253:0:6521:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.535475:0:6521:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.535488:0:6521:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120991.535492:0:6521:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.535500:0:6521:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.535516:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6900) 00010000:00010000:3.0:1789120991.535520:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789120991.535525:0:6521:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.535532:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830febe lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6521 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789120991.535626:0:6521:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789120991.535690:0:6521:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1789120991.535703:0:6521:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 441724881737ns, next at 442724879163ns, rc = 0 00000001:00080000:3.0:1789120991.535710:0:6521:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:3.0:1789120991.535733:0:6521:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6900) 00010000:00010000:3.0:1789120991.535736:0:6521:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789120991.535744:0:6521:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830fea9 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec1d expref: 35 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120991.535866:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913fd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12523:x1876028947515392:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 13423us (13695us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1789120991.535875:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 38 00000020:00080000:3.0:1789120991.535879:0:6521:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789120991.539533:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.539651:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947515648 00000100:00100000:2.0:1789120991.539661:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947515648 00000100:00100000:2.0:1789120991.539727:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 162 00000100:00100000:2.0:1789120991.539738:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12523:x1876028947515648:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789120991.539764:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120991.539798:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fec5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec24 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.540248:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec24 expref: 35 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.540264:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fec5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec24 expref: 35 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.540283:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:2.0:1789120991.540286:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120991.540290:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1200, rc 0) 00000100:00100000:2.0:1789120991.540385:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bccf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12523:x1876028947515648:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 648us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120991.540394:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 162 00000100:00100000:2.0:1789120991.545926:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120991.546252:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947515904 00000100:00100000:0.0:1789120991.546261:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947515904 00000100:00100000:0.0:1789120991.546359:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:0.0:1789120991.546369:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12523:x1876028947515904:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789120991.546606:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+36:12523:x1876028947515904:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 238us (690us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1789120991.546614:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:3.0:1789120991.656561:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.656667:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947516160 00000100:00100000:2.0:1789120991.656676:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947516160 00000100:00100000:2.0:1789120991.657046:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 163 00000100:00100000:2.0:1789120991.657057:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+36:12533:x1876028947516160:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789120991.657083:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120991.657601:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fecc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec2b expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120991.658472:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789120991.658594:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fecc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec2b expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.658608:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468a3998700) 00010000:00010000:2.0:1789120991.658626:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120991.658631:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830fecc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec2b expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.658645:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0400, rc 0) 00000100:00100000:2.0:1789120991.661316:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a692c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:12533:x1876028947516160:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 4249us (4752us total) trans 4294967435 rc 301/301 00000100:00100000:2.0:1789120991.661331:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 163 00000100:00100000:1.0:1789120991.671278:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.671459:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947516288 00000100:00100000:2.0:1789120991.671470:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947516288 00000100:00100000:2.0:1789120991.671534:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 164 00000100:00100000:2.0:1789120991.671544:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:12533:x1876028947516288:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:2.0:1789120991.671622:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830feda lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.671640:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830feda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.671651:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830feda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.671661:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fee1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.671668:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.671674:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.671776:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a830fee8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.671802:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a830fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.671809:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a830fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789120991.675902:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a830fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.675929:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830feda lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.675948:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830feda lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676244:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830feda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676251:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120991.676255:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830feda lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676263:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830feda lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676279:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789120991.676282:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120991.676287:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830feda lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676293:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a830feda lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676310:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fee1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676316:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fee1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676345:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fee1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676350:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120991.676353:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fee1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676359:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fee1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676443:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468886f6200) 00010000:00010000:3.0:1789120991.676446:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120991.676450:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fee1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676456:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1e00/0xb74d2367a830fee1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676467:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a830fee8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676474:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a830fee8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676480:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a830fee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676485:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3a600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120991.676488:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a830fee8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676504:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a830fee8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676512:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:3.0:1789120991.676514:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120991.676517:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a830fee8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120991.676523:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a830fee8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120991.676626:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:12533:x1876028947516288:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 5078us (5353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120991.676636:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 164 00000100:00100000:1.0:1789120991.680311:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120991.680615:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947516544 00000100:00100000:3.0:1789120991.680625:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947516544 00000100:00100000:3.0:1789120991.680693:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:3.0:1789120991.680715:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:12533:x1876028947516544:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789120991.682202:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:12533:x1876028947516544:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 1491us (1892us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789120991.682214:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:2.0:1789120991.733419:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120991.733531:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947516800 00000100:00100000:0.0:1789120991.733540:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947516800 00000100:00100000:0.0:1789120991.733602:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 165 00000100:00100000:0.0:1789120991.733627:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:12536:x1876028947516800:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789120991.733655:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120991.733678:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a830feef lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec32 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.733763:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fef6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.733799:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fef6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.733855:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fef6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.733870:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830fefd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.733887:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830fefd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.733893:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830fefd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734292:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830ff04 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734301:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830ff04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734309:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830ff04 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120991.734331:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789120991.734407:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fef6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734414:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fef6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734421:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fef6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734427:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120991.734431:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fef6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734439:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fef6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734450:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:0.0:1789120991.734454:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120991.734459:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fef6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734465:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a830fef6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734477:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830fefd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734483:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830fefd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734499:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830fefd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734504:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120991.734508:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830fefd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734514:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830fefd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734522:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468886f6200) 00010000:00010000:0.0:1789120991.734525:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120991.734528:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830fefd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734533:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a830fefd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734572:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a830feef lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec32 expref: 41 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734586:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830ff04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec32 expref: 40 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120991.734593:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:0.0:1789120991.734595:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120991.734598:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22800, rc 0) 00000100:00100000:0.0:1789120991.734649:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+40:12536:x1876028947516800:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1025us (1240us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789120991.734666:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 165 00000100:00100000:1.0:1789120991.739320:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120991.739483:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947516928 00000100:00100000:2.0:1789120991.739492:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947516928 00000100:00100000:2.0:1789120991.739557:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 166 00000100:00100000:2.0:1789120991.739567:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+40:12536:x1876028947516928:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:2.0:1789120991.739633:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a830ff12 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.739651:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a830ff12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.739663:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a830ff12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.739715:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a830ff12 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.739722:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a830ff12 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.739729:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a830ff12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.739735:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3a400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120991.739753:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a830ff12 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.739762:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a830ff12 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.739796:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:2.0:1789120991.739799:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120991.739804:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a830ff12 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120991.739855:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a830ff12 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120991.740116:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bcf840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+40:12536:x1876028947516928:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 549us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120991.740124:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 166 00000100:00100000:1.0:1789120991.745782:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120991.746082:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947517184 00000100:00100000:3.0:1789120991.746092:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947517184 00000100:00100000:3.0:1789120991.746145:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:3.0:1789120991.746155:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+40:12536:x1876028947517184:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789120991.746399:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+41:12536:x1876028947517184:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 244us (625us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789120991.746424:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 41 00010000:00010000:0.0:1789120991.954138:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120992.216983:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120992.217147:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947517440 00000100:00100000:1.0:1789120992.217158:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947517440 00000100:00100000:1.0:1789120992.217224:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:1.0:1789120992.217234:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+41:12567:x1876028947517440:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:1.0:1789120992.217271:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120992.217294:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff19 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec39 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.217405:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830ff20 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.217421:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830ff20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.217433:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830ff20 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120992.217445:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789120992.217560:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff19 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec39 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.217576:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830ff20 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec39 expref: 43 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.217585:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:1.0:1789120992.217601:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120992.217605:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3a00, rc 0) 00000100:00100000:1.0:1789120992.217673:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a69680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:12567:x1876028947517440:12345-192.168.202.32@tcp:101:cat.0 Request processed in 440us (699us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1789120992.217681:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:0.0:1789120992.224544:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120992.224596:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947517696 00000100:00100000:3.0:1789120992.224606:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947517696 00000100:00100000:3.0:1789120992.224667:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:3.0:1789120992.224680:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:12567:x1876028947517696:12345-192.168.202.32@tcp:35:cat.0 00000100:00100000:0.0:1789120992.224758:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120992.227388:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947517824 00000100:00100000:1.0:1789120992.227405:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947517824 00000100:00100000:1.0:1789120992.227517:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:1.0:1789120992.227531:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+44:2412:x1876028947517824:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120992.227550:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120992.227585:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830ff20 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec39 expref: 44 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.227610:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:1.0:1789120992.227617:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120992.227692:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:2412:x1876028947517824:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 165us (2934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120992.227701:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:3.0:1789120992.229278:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:12567:x1876028947517696:12345-192.168.202.32@tcp:35:cat.0 Request processed in 4596us (4734us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1789120992.229289:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:0.0:1789120992.367214:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120992.367303:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947518080 00000100:00100000:2.0:1789120992.367312:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947518080 00000100:00100000:2.0:1789120992.367382:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 168 00000100:00100000:2.0:1789120992.367393:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:12573:x1876028947518080:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:2.0:1789120992.367420:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120992.367424:0:11088:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789120992.367452:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0c00/0xb74d2367a830fe86 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec0f expref: 43 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.367472:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:2.0:1789120992.367477:0:11088:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120992.367491:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a830ff2e lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec40 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.367616:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.367630:0:11088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830ff04 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec32 expref: 43 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.367638:0:11088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.367670:0:11088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830ff04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec32 expref: 43 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.367684:0:11088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830ff04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec32 expref: 43 pid: 11088 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120992.367698:0:11088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970661248:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120992.367864:0:11088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120992.381904:0:11088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2fc00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970661248:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120992.381945:0:11088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120992.382270:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120992.382352:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947518208 00000100:00100000:2.0:1789120992.382359:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947518208 00010000:00010000:2.0:1789120992.382406:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830ff04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec32 expref: 44 pid: 11088 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120992.382455:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 97 00000100:00100000:2.0:1789120992.382465:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+44:2411:x1876028947518208:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120992.382480:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120992.382486:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830ff04 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec32 expref: 44 pid: 11088 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.382511:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830ff04 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec32 expref: 44 pid: 11088 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.382534:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a830ff04 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec32 expref: 44 pid: 11088 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.382549:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:2.0:1789120992.382554:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.382563:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.382571:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120992.382596:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120992.382653:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:2411:x1876028947518208:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 188us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120992.382661:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 97 00010000:00010000:0.0:1789120992.383048:0:11088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120992.383056:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120992.383074:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789120992.383218:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a830ff2e lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec40 expref: 44 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120992.383235:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec40 expref: 43 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120992.383244:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:0.0:1789120992.383247:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789120992.383314:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3ac00, rc 0) 00000100:00100000:0.0:1789120992.383389:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:12573:x1876028947518080:12345-192.168.202.32@tcp:101:dd.0 Request processed in 15998us (16185us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1789120992.383410:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 168 00000100:00100000:0.0:1789120992.416447:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120992.416554:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947518336 00000100:00100000:1.0:1789120992.416564:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947518336 00000100:00100000:1.0:1789120992.416629:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 169 00000100:00100000:1.0:1789120992.416640:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:12573:x1876028947518336:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:1.0:1789120992.416668:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120992.416688:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830ff43 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec47 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.416722:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff4a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.416750:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.416761:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff4a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.416909:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a830ff43 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec47 expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.416938:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec47 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.416947:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:1.0:1789120992.416950:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789120992.416954:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3400, rc 0) 00000100:00100000:1.0:1789120992.417020:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+44:12573:x1876028947518336:12345-192.168.202.32@tcp:101:dd.0 Request processed in 382us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120992.417028:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 169 00000100:00100000:2.0:1789120992.420531:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120992.420980:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947518592 00000100:00100000:3.0:1789120992.420991:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947518592 00000100:00100000:3.0:1789120992.421054:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 170 00000100:00100000:3.0:1789120992.421065:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+44:12573:x1876028947518592:12345-192.168.202.32@tcp:36:dd.0 00010000:00010000:3.0:1789120992.421585:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.421602:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.421613:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789120992.421661:0:9342:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:3.0:1789120992.421684:0:9342:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000008ecc5729 reply state 00000000ffbc6db1 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.421696:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.421724:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:3.0:1789120992.421726:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789120992.421731:0:9342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789120992.425035:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+47:12573:x1876028947518592:12345-192.168.202.32@tcp:36:dd.0 Request processed in 3960us (4501us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1789120992.425049:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 170 00000020:00080000:3.0:1789120992.425056:0:9342:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789120992.658145:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120992.658169:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970661376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120992.658256:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.658529:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970661632:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.658562:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.658588:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970662144:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.658612:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.658633:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970662656:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.658654:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.658672:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1789120992.658678:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970661760:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.658704:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.658721:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970662272:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.658743:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.658758:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467831fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970662784:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.658815:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.658868:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970661760 00000100:00100000:3.0:1789120992.658876:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970661760 00000100:00100000:3.0:1789120992.658951:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789120992.658959:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970661760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659013:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a6ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970661760:12345-0@lo:400:kworker.0 Request processed in 55us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.659021:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:3.0:1789120992.659051:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970661504:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659080:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.659099:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970662016:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.659137:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970662528:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659158:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.659175:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789120992.659181:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970661888:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659204:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.659215:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970662400:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659235:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.659251:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970662912:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659272:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120992.659295:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970662016 00000100:00100000:3.0:1789120992.659298:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970662016 00000100:00100000:3.0:1789120992.659321:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789120992.659328:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970662016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659365:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b91680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970662016:12345-0@lo:400:kworker.0 Request processed in 37us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.659371:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1789120992.659415:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970661760:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659443:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970662016:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659459:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970661632 00000100:00100000:3.0:1789120992.659463:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970661632 00000100:00100000:3.0:1789120992.659482:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970662144 00000100:00100000:3.0:1789120992.659485:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970662144 00000100:00100000:3.0:1789120992.659507:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970662656 00000100:00100000:3.0:1789120992.659510:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970662656 00000100:00100000:3.0:1789120992.659521:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970662272 00000100:00100000:3.0:1789120992.659523:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970662272 00000100:00100000:3.0:1789120992.659533:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970662528 00000100:00100000:3.0:1789120992.659536:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970662528 00000100:00100000:3.0:1789120992.659547:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970661888 00000100:00100000:3.0:1789120992.659550:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970661888 00000100:00100000:3.0:1789120992.659563:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789120992.659569:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970661632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659605:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a683c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970661632:12345-0@lo:400:kworker.0 Request processed in 36us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.659612:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1789120992.659625:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789120992.659631:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970662144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659660:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a68f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970662144:12345-0@lo:400:kworker.0 Request processed in 30us (1047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.659666:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1789120992.659694:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789120992.659702:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970662656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659730:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a69a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970662656:12345-0@lo:400:kworker.0 Request processed in 29us (1075us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.659746:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00000100:00100000:3.0:1789120992.659759:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789120992.659765:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970662272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659807:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970662272:12345-0@lo:400:kworker.0 Request processed in 42us (1063us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.659813:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:3.0:1789120992.659854:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789120992.659860:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970662528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659894:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970662528:12345-0@lo:400:kworker.0 Request processed in 34us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.659899:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00000100:00100000:3.0:1789120992.659911:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1789120992.659918:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970661888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.659944:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970661888:12345-0@lo:400:kworker.0 Request processed in 27us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.659949:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00080000:3.0:1789120992.659965:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120992.659968:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789120992.659987:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d0b40 x1876028970662272/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120992.659998:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970662272:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.660009:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970661632:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.660018:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970662144:0@lo:400:kworker.0 00010000:00080000:3.0:1789120992.660038:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d3840 x1876028970662656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789120992.660048:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d3840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970662656:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.660082:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970661888:0@lo:400:kworker.0 00000100:00100000:3.0:1789120992.660092:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970662528:0@lo:400:kworker.0 00000100:00100000:1.0:1789120992.660189:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970661504 00000100:00100000:1.0:1789120992.660194:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970661504 00000100:00100000:1.0:1789120992.660233:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1789120992.660241:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970661504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789120992.660282:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970661504:12345-0@lo:400:kworker.0 Request processed in 43us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120992.660288:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 461 00000100:00100000:1.0:1789120992.660319:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970661504:0@lo:400:kworker.0 00000100:00100000:2.0:1789120992.660485:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970661376 00000100:00100000:2.0:1789120992.660489:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970661376 00000100:00100000:2.0:1789120992.660522:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789120992.660528:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784a6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970661376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789120992.660551:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789120992.660587:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784a6b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970661376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (2331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120992.660600:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1789120992.660624:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970662784 00000100:00100000:2.0:1789120992.660628:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970662784 00000100:00100000:2.0:1789120992.660650:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970662400 00000100:00100000:2.0:1789120992.660652:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970662400 00000100:00100000:2.0:1789120992.660663:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970662912 00000100:00100000:2.0:1789120992.660666:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970662912 00000100:00100000:2.0:1789120992.660677:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789120992.660683:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970662784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120992.660720:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970662784:12345-0@lo:400:kworker.0 Request processed in 37us (1904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120992.660727:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789120992.660739:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789120992.660745:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970662400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120992.660772:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970662400:12345-0@lo:400:kworker.0 Request processed in 28us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120992.660788:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789120992.660799:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789120992.660805:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970662912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120992.660855:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970662912:12345-0@lo:400:kworker.0 Request processed in 49us (1581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120992.660860:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1789120992.660876:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789120992.660878:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120992.660896:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467831fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970662784:0@lo:400:kworker.0 00000100:00100000:0.0:1789120992.661004:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120992.661019:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970663040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120992.661053:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120992.661164:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970663040 00000100:00100000:2.0:1789120992.661175:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970663040 00000100:00100000:2.0:1789120992.661209:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789120992.661216:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970663040:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789120992.661227:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1789120992.661257:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fa940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970663040:12345-0@lo:13:osp-pre-0-1.0 Request processed in 42us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120992.661264:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000004:00080000:1.0:1789120992.661553:0:9819:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 442850731174ns, next at 443850728291ns, rc = 0 00000100:00100000:1.0:1789120992.661581:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789120992.661592:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970663168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120992.661623:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789120992.661651:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970663168 00000100:00100000:1.0:1789120992.661655:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970663168 00000100:00100000:1.0:1789120992.661679:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789120992.661686:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970663168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789120992.661698:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789120992.661732:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970663168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 47us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120992.661738:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789120992.661771:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970663168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789120992.661812:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970662400:0@lo:400:kworker.0 00000100:00100000:1.0:1789120992.661848:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f9d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970662912:0@lo:400:kworker.0 00000100:00100000:1.0:1789120992.661865:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970661376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789120992.662110:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970663040:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120992.719131:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120992.719173:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120992.719201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120992.719246:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120992.719290:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947518720 00000100:00100000:2.0:1789120992.719297:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947519104 00000100:00100000:0.0:1789120992.719299:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947518720 00000100:00100000:2.0:1789120992.719300:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947519104 00000100:00100000:0.0:1789120992.719477:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 462 00000100:00100000:0.0:1789120992.719488:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947518720:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120992.719562:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947518720:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 76us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120992.719570:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 462 00000100:00100000:0.0:1789120992.719620:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120992.719729:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120992.719748:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947518976 00000100:00100000:0.0:1789120992.719751:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947518976 00000100:00100000:2.0:1789120992.719805:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:2.0:1789120992.719815:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947519104:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789120992.719875:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f92c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947519104:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 62us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.719931:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947518848 00000100:00100000:3.0:1789120992.719935:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947518848 00000100:00100000:3.0:1789120992.719962:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947519360 00000100:00100000:3.0:1789120992.719964:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947519360 00000100:00100000:3.0:1789120992.719978:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947519232 00000100:00100000:3.0:1789120992.719980:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947519232 00000100:00100000:3.0:1789120992.719993:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 373 00000100:00100000:3.0:1789120992.719999:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947518848:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120992.720027:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947518848:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.720033:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 373 00000100:00100000:3.0:1789120992.720047:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 374 00000100:00100000:3.0:1789120992.720051:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947519360:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120992.720071:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947519360:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 20us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.720077:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 374 00000100:00100000:3.0:1789120992.720087:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 375 00000100:00100000:3.0:1789120992.720092:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947519232:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120992.720112:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947519232:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 20us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.720132:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 375 00000100:00080000:3.0:1789120992.720172:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789120992.720177:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120992.721429:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:0.0:1789120992.721446:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947518976:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120992.721493:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947518976:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 54us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120992.721512:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:2.0:1789120992.728522:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:2.0:1789120992.876687:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120992.876791:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947519488 00000100:00100000:3.0:1789120992.876801:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947519488 00000100:00100000:3.0:1789120992.876891:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 171 00000100:00100000:3.0:1789120992.876902:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+47:12587:x1876028947519488:12345-192.168.202.32@tcp:101:stat.0 00010000:00010000:3.0:1789120992.876929:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120992.876951:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830ff58 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec4e expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.877014:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ff5f lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.877028:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ff5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.877041:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ff5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.877052:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ff66 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.877059:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.877064:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.877146:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.877170:0:9342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec40 expref: 48 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.877178:0:9342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.877212:0:9342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec40 expref: 48 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.877236:0:9342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec40 expref: 48 pid: 11088 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120992.877257:0:9342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970663296:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120992.877361:0:9342:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120992.880450:0:9342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970663296:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120992.880481:0:9342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120992.882467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120992.883983:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947519744 00000100:00100000:0.0:1789120992.883999:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947519744 00000100:00100000:0.0:1789120992.884075:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:0.0:1789120992.884086:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+49:6183:x1876028947519744:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789120992.885619:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+50:6183:x1876028947519744:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 1527us (3587us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789120992.885632:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00000001:00080000:2.0:1789120992.894939:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000004:00080000:2.0:1789120992.894971:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:2.0:1789120992.895021:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1789120992.895041:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94678108a6c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1789120992.895047:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff946782acb300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94678108a600 00000020:00080000:2.0:1789120992.895051:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff946782acb700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9468999bbc00 00000100:00100000:0.0:1789120992.895731:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120992.895760:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970663424:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789120992.895891:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789120992.896721:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789120992.896887:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789120992.896911:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970663424 00000100:00100000:3.0:1789120992.896921:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970663424 00000100:00100000:3.0:1789120992.896991:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789120992.897002:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1876028970663424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789120992.897064:0:8434:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:4 count 1 00002000:00010000:3.0:1789120992.897110:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6aa3d1de, atime: 0x6aa3d1df, ctime: 0x6aa3d1de, blocks: 0x8 00010000:00010000:3.0:1789120992.897120:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af4e6f3f/0xb74d2367a830ff74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.897141:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1789120992.897166:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120992.897273:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af4e6f3f/0xb74d2367a830ff74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.897296:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af4e6f3f/0xb74d2367a830ff74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.897308:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af4e6f3f/0xb74d2367a830ff74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.897317:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af4e6f3f/0xb74d2367a830ff74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.897560:0:8434:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789120992.897760:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f9e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3644:x1876028970663424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 758us (1867us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789120992.897770:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00010000:3.0:1789120992.897816:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120992.897848:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af4e6f3f/0xb74d2367a830ff74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.897858:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789120992.897863:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af4e6f3f/0xb74d2367a830ff74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.897875:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af4e6f3f/0xb74d2367a830ff74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.897912:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af4e6f3f/0xb74d2367a830ff74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.897921:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af4e6f3f/0xb74d2367a830ff74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.897942:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120992.897944:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120992.897946:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789120992.897990:0:3644:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9467848f9680/2, rc 0, transno 4294967308 00000100:00100000:3.0:1789120992.897997:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970663424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789120992.902675:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120992.902912:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947519872 00000100:00100000:0.0:1789120992.902933:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947519872 00010000:00010000:0.0:1789120992.903002:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec40 expref: 22 pid: 11088 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120992.903068:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 98 00000100:00100000:0.0:1789120992.903080:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:2411:x1876028947519872:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120992.903101:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120992.903110:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec40 expref: 22 pid: 11088 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120992.903147:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec40 expref: 22 pid: 11088 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120992.903671:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ac00/0xb74d2367a830ff35 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec40 expref: 22 pid: 11088 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120992.903697:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:0.0:1789120992.903704:0:6503:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120992.903716:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120992.903726:0:6503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120992.903766:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120992.903906:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835e8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:2411:x1876028947519872:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 827us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120992.903916:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 98 00010000:00010000:3.0:1789120992.907655:0:9342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.907677:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120992.907762:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789120992.907768:0:9342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120992.907818:0:9342:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.907861:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.907873:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ff5f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.907907:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ff5f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.907915:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ff5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.907922:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120992.907927:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ff5f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.907937:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ff5f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.907968:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789120992.907972:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120992.907978:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ff5f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.907984:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ff5f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.908004:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ff66 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.908009:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ff66 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.908015:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ff66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.908020:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120992.909658:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ff66 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.909680:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ff66 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.909701:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468886f6200) 00010000:00010000:3.0:1789120992.909705:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120992.909712:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ff66 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.909721:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ff66 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.909805:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830ff58 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec4e expref: 21 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.909853:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec4e expref: 20 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120992.909862:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:3.0:1789120992.909865:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120992.909869:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55e00, rc 0) 00000100:00100000:3.0:1789120992.909990:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:12587:x1876028947519488:12345-192.168.202.32@tcp:101:stat.0 Request processed in 33088us (33314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120992.910001:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 171 00010000:00010000:1.0:1789120992.911951:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.911980:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.911989:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.911996:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120992.912001:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912034:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912055:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9468886f6800) 00010000:00010000:1.0:1789120992.912058:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120992.912064:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912071:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54000/0xb74d2367a830fe08 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912102:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912109:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912115:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912120:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120992.912123:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912129:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912138:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:1.0:1789120992.912140:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120992.912144:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912170:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a830fe0f lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912191:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912198:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912203:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912208:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120992.912211:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912216:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912225:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468886f6200) 00010000:00010000:1.0:1789120992.912228:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120992.912231:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912236:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a830fe4e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912253:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912259:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912272:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912277:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120992.912280:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912287:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912295:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:1.0:1789120992.912298:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120992.912301:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.912308:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a830ff51 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120992.980591:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120993.022365:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120993.022506:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947520128 00000100:00100000:0.0:1789120993.022520:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947520128 00000100:00100000:0.0:1789120993.022627:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 172 00000100:00100000:0.0:1789120993.022641:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+17:12593:x1876028947520128:12345-192.168.202.32@tcp:36:truncate.0 00010000:00010000:0.0:1789120993.022723:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120993.022761:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a830ff6d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec4e expref: 17 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.022876:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:0.0:1789120993.022883:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120993.023163:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.023182:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.023195:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120993.023248:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:0.0:1789120993.023272:0:6518:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006ef4e8b0 reply state 00000000c4c9f3b8 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.023285:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.023292:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:0.0:1789120993.023295:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789120993.023299:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:3.0:1789120993.023549:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120993.025964:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:12593:x1876028947520128:12345-192.168.202.32@tcp:36:truncate.0 Request processed in 3310us (3600us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1789120993.025982:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 172 00000020:00080000:0.0:1789120993.025993:0:6518:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789120993.174606:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789120993.174641:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970663552:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789120993.174751:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120993.174868:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970663552 00000100:00100000:3.0:1789120993.174879:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970663552 00000100:00100000:3.0:1789120993.174975:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789120993.174984:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970663552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789120993.175022:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:3.0:1789120993.175088:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970663552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120993.175097:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789120993.175310:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970663552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789120993.245802:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120993.246113:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947520256 00000100:00100000:1.0:1789120993.246125:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947520256 00000100:00100000:1.0:1789120993.246208:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 173 00000100:00100000:1.0:1789120993.246220:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:12607:x1876028947520256:12345-192.168.202.32@tcp:101:stat.0 00010000:00010000:1.0:1789120993.246254:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120993.246281:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830ff82 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec55 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246392:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ff89 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246411:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ff89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246424:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ff89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246441:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830ff90 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246448:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830ff90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246455:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830ff90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246554:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246564:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246571:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120993.246624:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789120993.246630:0:11088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789120993.246654:0:11088:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246679:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246689:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ff89 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246696:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ff89 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246703:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ff89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246710:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120993.246714:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ff89 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246723:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ff89 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246737:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:1.0:1789120993.246740:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120993.246746:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ff89 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246753:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ff89 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246790:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830ff90 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246797:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830ff90 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246810:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830ff90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.246816:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120993.248598:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830ff90 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.248626:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830ff90 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.248648:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bfb00) 00010000:00010000:1.0:1789120993.248652:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120993.248658:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830ff90 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.248667:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a830ff90 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.248744:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a830ff82 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec55 expref: 21 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.248997:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec55 expref: 20 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.249008:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:1.0:1789120993.249010:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120993.249013:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2c00, rc 0) 00000100:00100000:1.0:1789120993.249195:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:12607:x1876028947520256:12345-192.168.202.32@tcp:101:stat.0 Request processed in 2974us (3405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120993.249228:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 173 00000100:00100000:2.0:1789120993.384275:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120993.384558:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947520512 00000100:00100000:3.0:1789120993.384572:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947520512 00000100:00100000:3.0:1789120993.384656:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 174 00000100:00100000:3.0:1789120993.384669:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:12617:x1876028947520512:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120993.384698:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120993.384730:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830ff9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec5c expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120993.385242:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789120993.385390:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830ff9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec5c expref: 22 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.385430:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468a3998700) 00010000:00010000:2.0:1789120993.385433:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120993.385440:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a830ff9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec5c expref: 22 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.385462:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55600, rc 0) 00000100:00100000:2.0:1789120993.385557:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:12617:x1876028947520512:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 886us (1292us total) trans 4294967447 rc 301/301 00000100:00100000:2.0:1789120993.385566:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 174 00000100:00100000:0.0:1789120993.398050:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120993.398447:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947520768 00000100:00100000:3.0:1789120993.398460:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947520768 00000100:00100000:3.0:1789120993.398532:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:3.0:1789120993.398545:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:12617:x1876028947520768:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789120993.398913:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913fe050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:12617:x1876028947520768:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 369us (879us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789120993.398922:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:2.0:1789120993.502388:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120993.503110:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947521024 00000100:00100000:0.0:1789120993.503126:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947521024 00000100:00100000:0.0:1789120993.503242:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 175 00000100:00100000:0.0:1789120993.503255:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:12623:x1876028947521024:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120993.503292:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120993.503322:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830ffac lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec63 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.503476:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.503494:0:6518:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec55 expref: 23 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.503505:0:6518:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.503548:0:6518:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec55 expref: 23 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.503564:0:6518:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec55 expref: 23 pid: 11088 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120993.503579:0:6518:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1876028970663680:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120993.503748:0:6518:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120993.510731:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120993.510902:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947521152 00000100:00100000:1.0:1789120993.510914:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947521152 00010000:00010000:1.0:1789120993.510984:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec55 expref: 24 pid: 11088 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120993.511041:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 99 00000100:00100000:1.0:1789120993.511053:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:2411:x1876028947521152:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120993.511073:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120993.511081:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec55 expref: 24 pid: 11088 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.511096:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec55 expref: 24 pid: 11088 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.511127:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:1.0:1789120993.511132:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.511143:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.511150:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.511174:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120993.511248:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:2411:x1876028947521152:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 196us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120993.511277:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 99 00010000:00010000:0.0:1789120993.512947:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a830ff97 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec55 expref: 23 pid: 11088 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120993.512977:0:6518:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848f8780 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6518:1876028970663680:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120993.513011:0:6518:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.513039:0:6518:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.513046:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120993.513183:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1789120993.513372:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a830ffac lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec63 expref: 24 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.513392:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec63 expref: 23 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.513403:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:0.0:1789120993.513407:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789120993.513411:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23400, rc 0) 00000100:00100000:0.0:1789120993.513492:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:12623:x1876028947521024:12345-192.168.202.32@tcp:101:bash.0 Request processed in 10238us (11119us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789120993.513503:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 175 00000100:00100000:3.0:1789120993.520621:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120993.520895:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947521408 00000100:00100000:1.0:1789120993.520909:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947521408 00000100:00100000:1.0:1789120993.520999:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 176 00000100:00100000:1.0:1789120993.521012:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:12623:x1876028947521408:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:1.0:1789120993.521341:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.521364:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.521379:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789120993.521437:0:11088:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1789120993.521461:0:11088:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000e615ad53 reply state 00000000582aa47a transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.521477:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.521486:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:1.0:1789120993.521489:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789120993.521494:0:11088:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120993.521623:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+26:12623:x1876028947521408:12345-192.168.202.32@tcp:36:bash.0 Request processed in 612us (1016us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789120993.521631:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 176 00000020:00080000:1.0:1789120993.521638:0:11088:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789120993.534082:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120993.534235:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947521536 00000100:00100000:3.0:1789120993.534249:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947521536 00000100:00100000:3.0:1789120993.534333:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 177 00000100:00100000:3.0:1789120993.534346:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+26:12623:x1876028947521536:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789120993.534389:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120993.534416:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ffc8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec6a expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.534540:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ffcf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.534560:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec63 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.534570:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ffcf lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.534616:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec63 expref: 27 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.534632:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec63 expref: 27 pid: 6518 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120993.534648:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970663808:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120993.535406:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120993.541095:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120993.541648:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d1a40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970663808:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120993.542009:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ffcf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120993.542231:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947521664 00000100:00100000:1.0:1789120993.542241:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947521664 00010000:00010000:1.0:1789120993.542293:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec63 expref: 28 pid: 6518 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120993.542415:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 100 00000100:00100000:1.0:1789120993.542428:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+28:2412:x1876028947521664:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120993.542448:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120993.542456:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec63 expref: 28 pid: 6518 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.542471:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec63 expref: 28 pid: 6518 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.542500:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a830ffb3 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec63 expref: 28 pid: 6518 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.542520:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:1.0:1789120993.542525:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ffcf lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.542537:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ffcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.542546:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ffcf lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.542577:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120993.542659:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2de00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:2412:x1876028947521664:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 233us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120993.542700:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 100 00010000:00010000:3.0:1789120993.543029:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ffcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.543037:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ffcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120993.543114:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789120993.543120:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120993.543145:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ffcf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.543185:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830ffc8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec6a expref: 27 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.543201:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ffcf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec6a expref: 26 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.543211:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:3.0:1789120993.543214:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120993.543216:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55a00, rc 0) 00000100:00100000:3.0:1789120993.543250:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+26:12623:x1876028947521536:12345-192.168.202.32@tcp:101:bash.0 Request processed in 8908us (9183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120993.543258:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 177 00000100:00100000:2.0:1789120993.547806:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120993.547934:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947521920 00000100:00100000:3.0:1789120993.547946:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947521920 00000100:00100000:3.0:1789120993.548013:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:3.0:1789120993.548024:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+26:12623:x1876028947521920:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:3.0:1789120993.548334:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12623:x1876028947521920:12345-192.168.202.32@tcp:35:bash.0 Request processed in 310us (541us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1789120993.548343:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:0.0:1789120993.659280:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120993.659403:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947522176 00000100:00100000:2.0:1789120993.659416:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947522176 00000100:00100000:2.0:1789120993.659501:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 178 00000100:00100000:2.0:1789120993.659514:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12633:x1876028947522176:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789120993.659546:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120993.659574:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a200/0xb74d2367a830ffd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec71 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120993.659730:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1789120993.659944:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a200/0xb74d2367a830ffd6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec71 expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.659963:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468a3998700) 00010000:00010000:2.0:1789120993.659986:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120993.659993:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a200/0xb74d2367a830ffd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec71 expref: 29 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.660010:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3a200, rc 0) 00000100:00100000:2.0:1789120993.660096:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+28:12633:x1876028947522176:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 584us (830us total) trans 4294967453 rc 301/301 00000100:00100000:2.0:1789120993.660105:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 178 00000100:00100000:1.0:1789120993.664970:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120993.665136:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947522304 00000100:00100000:2.0:1789120993.665149:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947522304 00000100:00100000:2.0:1789120993.665231:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 179 00000100:00100000:2.0:1789120993.665245:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+28:12633:x1876028947522304:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:2.0:1789120993.665357:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a830ffe4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665380:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a830ffe4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665396:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a830ffe4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665418:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a830ffeb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665426:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a830ffeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665433:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a830ffeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665534:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a830fff2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665565:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a830fff2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665572:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a830fff2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120993.665635:0:9342:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a830fff2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665651:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a830ffe4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665658:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a830ffe4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665665:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a830ffe4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665672:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3bc00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120993.665678:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a830ffe4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665687:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a830ffe4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665701:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:2.0:1789120993.665704:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120993.665710:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a830ffe4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665716:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a830ffe4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665742:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a830ffeb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665748:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a830ffeb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665754:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a830ffeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665759:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3ba00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120993.665762:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a830ffeb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665783:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a830ffeb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665791:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff946888819600) 00010000:00010000:2.0:1789120993.665794:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120993.665797:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a830ffeb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665803:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a830ffeb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665859:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a830fff2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665866:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a830fff2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665872:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a830fff2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665884:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3b800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120993.665888:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a830fff2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665894:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a830fff2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.665902:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:2.0:1789120993.665905:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120993.665908:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a830fff2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.666473:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a830fff2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120993.666592:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f9c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+28:12633:x1876028947522304:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 1346us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120993.666603:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 179 00000100:00100000:2.0:1789120993.670395:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120993.670480:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947522560 00000100:00100000:3.0:1789120993.670493:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947522560 00000100:00100000:3.0:1789120993.670586:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:3.0:1789120993.670597:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+28:12633:x1876028947522560:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789120993.671390:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:12633:x1876028947522560:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 789us (1005us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1789120993.671401:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:0.0:1789120993.726879:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120993.728200:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947522816 00000100:00100000:3.0:1789120993.728215:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947522816 00000100:00100000:3.0:1789120993.728304:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 180 00000100:00100000:3.0:1789120993.728316:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:12636:x1876028947522816:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120993.728349:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120993.728376:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830fff9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec78 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.728482:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310000 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.728501:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310000 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.728515:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310000 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.728531:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310007 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.728537:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310007 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.728544:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310007 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.728713:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831000e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.728724:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831000e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.728731:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831000e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120993.728744:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789120993.729377:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310000 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729389:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310000 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729397:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310000 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729404:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120993.729410:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310000 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729418:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310000 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729434:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789120993.729437:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120993.729443:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310000 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729465:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310000 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729482:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310007 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729487:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310007 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729494:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310007 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729499:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120993.729502:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310007 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729509:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310007 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729517:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468886f6900) 00010000:00010000:3.0:1789120993.729519:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120993.729523:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310007 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729528:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310007 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729590:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a830fff9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec78 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729606:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831000e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec78 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.729620:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:3.0:1789120993.729623:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120993.729626:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54a00, rc 0) 00000100:00100000:3.0:1789120993.730737:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+31:12636:x1876028947522816:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 2410us (3861us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789120993.730750:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 180 00000100:00100000:1.0:1789120993.735049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120993.735118:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120993.735226:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947522944 00000100:00100000:0.0:1789120993.735239:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947522944 00000100:00100000:0.0:1789120993.735333:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:0.0:1789120993.735346:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+31:2410:x1876028947522944:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120993.735367:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120993.735401:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831000e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec78 expref: 31 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120993.735436:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:0.0:1789120993.735441:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120993.735498:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:2410:x1876028947522944:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 156us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120993.735504:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789120993.736176:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947523072 00000100:00100000:2.0:1789120993.736184:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947523072 00000100:00100000:2.0:1789120993.736264:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 181 00000100:00100000:2.0:1789120993.736274:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:12636:x1876028947523072:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:2.0:1789120993.736355:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a831001c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.736376:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a831001c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.736404:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a831001c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.736450:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a831001c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.736458:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a831001c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.736466:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a831001c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.736473:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3ba00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120993.736478:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a831001c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.736486:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a831001c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.736497:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:2.0:1789120993.736501:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120993.736506:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a831001c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.736513:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a831001c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120993.736584:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:12636:x1876028947523072:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 312us (1466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120993.736592:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 181 00000100:00100000:0.0:1789120993.739467:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120993.739552:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947523328 00000100:00100000:2.0:1789120993.739562:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947523328 00000100:00100000:2.0:1789120993.739664:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:2.0:1789120993.739676:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:12636:x1876028947523328:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789120993.740264:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+31:12636:x1876028947523328:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 586us (807us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789120993.740275:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:1.0:1789120993.885181:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120993.885510:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947523584 00000100:00100000:2.0:1789120993.885523:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947523584 00000100:00100000:2.0:1789120993.885618:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 182 00000100:00100000:2.0:1789120993.885630:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+31:12654:x1876028947523584:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:2.0:1789120993.885661:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120993.885691:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310023 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec7f expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.885926:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a831002a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.885946:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a831002a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.885964:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a831002a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120993.885978:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789120993.886119:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310023 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec7f expref: 34 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.886141:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a831002a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec7f expref: 33 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.886170:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:2.0:1789120993.886173:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789120993.886177:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3bc00, rc 0) 00000100:00100000:2.0:1789120993.886276:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:12654:x1876028947523584:12345-192.168.202.32@tcp:101:cat.0 Request processed in 648us (1124us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1789120993.886293:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 182 00000100:00100000:1.0:1789120993.921788:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120993.923232:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947523712 00000100:00100000:3.0:1789120993.923252:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947523712 00000100:00100000:3.0:1789120993.923440:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 183 00000100:00100000:3.0:1789120993.923456:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf64d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:12655:x1876028947523712:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120993.923496:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120993.923531:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec86 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.923639:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a831003f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.923659:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a831003f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.923689:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a831003f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120993.923745:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1789120993.923749:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789120993.923796:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a831003f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.923876:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec86 expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.923900:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a831003f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec86 expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120993.923910:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789120993.924218:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789120993.924225:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55800, rc 0) 00000100:00100000:3.0:1789120993.924325:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf64d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12655:x1876028947523712:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 871us (2566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120993.924334:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 183 00000100:00100000:1.0:1789120993.934258:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120993.934435:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947524096 00000100:00100000:3.0:1789120993.934449:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947524096 00000100:00100000:3.0:1789120993.934617:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:3.0:1789120993.934630:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12655:x1876028947524096:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789120993.935289:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12655:x1876028947524096:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 656us (1040us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1789120993.935300:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:1.0:1789120993.941641:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120993.942142:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947524224 00000100:00100000:2.0:1789120993.942226:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947524224 00000100:00100000:2.0:1789120993.942323:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:2.0:1789120993.942337:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12655:x1876028947524224:12345-192.168.202.32@tcp:103:lfs.0 00010000:00010000:2.0:1789120993.942360:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789120993.942394:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a830ffcf lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec6a expref: 35 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.942423:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a831002a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec7f expref: 34 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.942437:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1200/0xb74d2367a830fec5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec24 expref: 33 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.942448:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:2.0:1789120993.942453:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120993.942635:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:12655:x1876028947524224:12345-192.168.202.32@tcp:103:lfs.0 Request processed in 300us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120993.942644:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:1.0:1789120993.947294:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120993.947406:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947524352 00000100:00100000:2.0:1789120993.947419:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947524352 00000100:00100000:2.0:1789120993.947546:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 184 00000100:00100000:2.0:1789120993.947558:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:12655:x1876028947524352:12345-192.168.202.32@tcp:58:lfs.0 00010000:00010000:2.0:1789120993.947724:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310046 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.947747:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310046 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120993.947776:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310046 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120993.947959:0:11088:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1789120993.948078:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:12655:x1876028947524352:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 521us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120993.948087:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 184 00000100:00100000:0.0:1789120993.980261:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120993.980439:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947524480 00000100:00100000:2.0:1789120993.980452:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947524480 00000100:00100000:2.0:1789120993.980535:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 185 00000100:00100000:2.0:1789120993.980547:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf661e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:12657:x1876028947524480:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789120993.980577:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120993.980607:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a831004d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec8d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.981893:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310054 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982273:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982293:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982321:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a831005b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982330:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a831005b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982337:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a831005b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982439:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982450:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982478:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120993.982535:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789120993.982541:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789120993.982566:0:6518:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982582:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982592:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310054 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982599:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310054 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982606:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310054 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982614:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120993.982619:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310054 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982628:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310054 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.982643:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:1.0:1789120993.982646:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120993.982652:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310054 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.983242:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310054 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.983261:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a831005b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.983267:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a831005b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.983273:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a831005b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.983277:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120993.983281:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a831005b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.983288:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a831005b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.983300:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bfb00) 00010000:00010000:1.0:1789120993.983303:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120993.983306:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a831005b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.983313:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a831005b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.983365:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a831004d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec8d expref: 34 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.983384:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec8d expref: 33 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120993.983401:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:1.0:1789120993.983404:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789120993.983406:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3600, rc 0) 00000100:00100000:1.0:1789120993.983579:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf661e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:12657:x1876028947524480:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 3032us (3329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120993.983590:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 185 00010000:00010000:0.0:1789120994.005883:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789120994.904052:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120994.904066:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120994.904119:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789120994.904128:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789120994.904316:0:14508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783f6ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970663936:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789120994.904447:0:14508:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120994.917714:0:14508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783f6ed00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970663936:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789120994.919703:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120994.920095:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947524608 00000100:00100000:3.0:1789120994.920108:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947524608 00000100:00100000:3.0:1789120994.920195:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 186 00000100:00100000:3.0:1789120994.920208:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:12668:x1876028947524608:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789120994.920254:0:6519:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789120994.920431:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:12668:x1876028947524608:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 224us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120994.920440:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 186 00000100:00100000:2.0:1789120994.929465:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120994.929556:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947524736 00000100:00100000:1.0:1789120994.929569:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947524736 00000100:00100000:1.0:1789120994.929651:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 187 00000100:00100000:1.0:1789120994.929675:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:12668:x1876028947524736:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789120994.929795:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310069 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930016:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310069 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930038:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310069 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930059:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310070 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930068:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310070 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930075:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310070 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930131:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310077 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930142:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930149:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120994.930210:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789120994.930216:0:11088:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789120994.930232:0:11088:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930247:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310069 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930255:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310069 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930262:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310069 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930269:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120994.930274:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310069 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930283:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310069 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930296:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:1.0:1789120994.930306:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120994.930313:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310069 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930320:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310069 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930334:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310070 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930340:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310070 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930347:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310070 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930353:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120994.930355:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310070 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930362:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310070 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930370:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9468852bff00) 00010000:00010000:1.0:1789120994.930372:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120994.930375:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310070 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930381:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310070 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930398:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310077 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930411:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310077 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930418:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310077 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930423:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120994.930427:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310077 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930434:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310077 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930443:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:1.0:1789120994.930446:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120994.930449:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310077 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.930455:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310077 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120994.930572:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:12668:x1876028947524736:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 Request processed in 909us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120994.930584:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 187 00000100:00100000:3.0:1789120994.939206:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120994.940052:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947524992 00000100:00100000:1.0:1789120994.940068:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947524992 00000100:00100000:1.0:1789120994.940149:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 188 00000100:00100000:1.0:1789120994.940162:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+33:12668:x1876028947524992:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120994.940189:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120994.940228:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a831007e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec94 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.940377:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310085 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.940395:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310085 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.940410:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310085 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120994.940424:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789120994.940527:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310085 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.940536:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310085 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.940543:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310085 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.940549:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120994.940554:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310085 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.940563:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310085 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.940578:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:1.0:1789120994.940582:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789120994.940587:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310085 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.940605:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310085 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.940658:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a831007e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec94 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.942095:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:1.0:1789120994.942099:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120994.942108:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a831007e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec94 expref: 35 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.942123:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3c00, rc 0) 00000100:00100000:1.0:1789120994.942213:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12668:x1876028947524992:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 2053us (3022us total) trans 4294967459 rc 301/301 00000100:00100000:1.0:1789120994.942223:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 188 00000100:00100000:2.0:1789120994.951424:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120994.951544:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947525120 00000100:00100000:3.0:1789120994.951558:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947525120 00000100:00100000:3.0:1789120994.951639:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 189 00000100:00100000:3.0:1789120994.951652:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467831fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12668:x1876028947525120:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789120994.951717:0:9342:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789120994.952018:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467831fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12668:x1876028947525120:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 366us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120994.952028:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 189 00000100:00100000:2.0:1789120994.957064:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120994.957339:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947525376 00000100:00100000:3.0:1789120994.957352:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947525376 00000100:00100000:3.0:1789120994.957488:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 190 00000100:00100000:3.0:1789120994.957500:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12668:x1876028947525376:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120994.957531:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120994.957535:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789120994.957574:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a831003f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec86 expref: 34 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120994.957599:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789120994.957607:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120994.957624:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310093 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ec9b expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789120994.958246:0:6520:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789120994.958464:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a831009a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120994.958481:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a831009a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120994.958494:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a831009a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120994.958566:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310093 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec9b expref: 36 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120994.958585:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a831009a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec9b expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120994.958594:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468886f6900) 00010000:00010000:3.0:1789120994.958597:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120994.958600:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54e00, rc 0) 00000100:00100000:3.0:1789120994.958693:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12668:x1876028947525376:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1195us (1644us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789120994.958703:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 190 00000100:00100000:3.0:1789120994.966343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120994.966790:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947525632 00000100:00100000:1.0:1789120994.966804:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947525632 00000100:00100000:1.0:1789120994.966939:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 191 00000100:00100000:1.0:1789120994.966952:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12668:x1876028947525632:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789120994.967029:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120994.967065:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a831009a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec9b expref: 35 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967088:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468886f6900) 00010000:00010000:1.0:1789120994.967104:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120994.967135:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83100a8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967169:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83100a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967182:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83100a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967200:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83100af lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x14aafe3d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967208:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83100af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x14aafe3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967215:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83100af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x14aafe3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967289:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83100a8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967296:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83100a8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967303:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83100a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967309:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120994.967314:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83100a8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967322:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83100a8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967332:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:1.0:1789120994.967341:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120994.967347:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83100a8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967354:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a83100a8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967364:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83100af lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x14aafe3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967369:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83100af lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x14aafe3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967375:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83100af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x14aafe3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967380:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120994.967383:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83100af lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x14aafe3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967389:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83100af lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x14aafe3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967397:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x14aafe3d (ffff9468852bff00) 00010000:00010000:1.0:1789120994.967400:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120994.967402:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83100af lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x14aafe3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120994.967408:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83100af lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x14aafe3d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120994.967522:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12668:x1876028947525632:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 572us (1193us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789120994.967537:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 191 00000100:00100000:0.0:1789120994.983394:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120994.989055:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947525760 00000100:00100000:2.0:1789120994.989075:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947525760 00000100:00100000:0.0:1789120994.989226:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 192 00000100:00100000:0.0:1789120994.989241:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12668:x1876028947525760:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120994.989352:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120994.989392:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a83100b6 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eca2 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120994.989448:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83100bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120994.989467:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83100bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120994.989492:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83100bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120994.989643:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a83100b6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca2 expref: 36 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120994.989665:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83100bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca2 expref: 35 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120994.989675:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:0.0:1789120994.989678:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789120994.989683:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23600, rc 0) 00000100:00100000:0.0:1789120994.989861:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783f6ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12668:x1876028947525760:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 622us (6484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120994.989872:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 192 00000100:00100000:2.0:1789120995.014303:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120995.014382:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947526016 00000100:00100000:2.0:1789120995.014395:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947526016 00000100:00100000:2.0:1789120995.014482:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 193 00000100:00100000:2.0:1789120995.014498:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12668:x1876028947526016:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789120995.014619:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.014643:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.014672:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120995.015304:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1789120995.015320:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 445204498201ns, next at 446204493779ns, rc = 0 00000004:00010000:2.0:1789120995.015388:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000056c5ffec reply state 0000000040ea30e5 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.015404:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.015413:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:2.0:1789120995.015416:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789120995.015422:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120995.015572:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914f5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:12668:x1876028947526016:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 1075us (1281us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789120995.015581:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 193 00000100:00080000:2.0:1789120995.015645:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789120995.021526:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120995.021579:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947526144 00000100:00100000:2.0:1789120995.021594:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947526144 00000100:00100000:2.0:1789120995.022384:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 194 00000100:00100000:2.0:1789120995.022400:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:12668:x1876028947526144:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120995.022436:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120995.022465:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83100cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eca9 expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.022538:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83100cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca9 expref: 38 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.022555:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83100cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca9 expref: 38 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.022574:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:2.0:1789120995.022577:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120995.022582:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3be00, rc 0) 00000100:00100000:2.0:1789120995.023766:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:12668:x1876028947526144:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 264us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120995.023787:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 194 00010000:00010000:3.0:1789120995.027544:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789120995.028716:0:15369:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789120995.028725:0:15369:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789120995.028766:0:15369:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789120995.028774:0:15369:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789120995.031405:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120995.032014:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947526272 00000100:00100000:3.0:1789120995.032027:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947526272 00000100:00100000:3.0:1789120995.032109:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:3.0:1789120995.032123:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947526272:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789120995.032380:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120995.033121:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947526272:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 996us (1726us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789120995.033146:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:1.0:1789120995.051962:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120995.052141:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947526528 00000100:00100000:2.0:1789120995.052153:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947526528 00000100:00100000:2.0:1789120995.052229:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:2.0:1789120995.052240:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:12668:x1876028947526528:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789120995.052580:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:12668:x1876028947526528:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 341us (633us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789120995.052590:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:2.0:1789120995.055373:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120995.055426:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947526784 00000100:00100000:2.0:1789120995.055437:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947526784 00000100:00100000:2.0:1789120995.055505:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 195 00000100:00100000:2.0:1789120995.055516:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:12668:x1876028947526784:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789120995.055676:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:12668:x1876028947526784:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 161us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120995.055685:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 195 00000100:00100000:1.0:1789120995.063497:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120995.074167:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947526912 00000100:00100000:3.0:1789120995.074187:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947526912 00000100:00100000:0.0:1789120995.076750:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 196 00000100:00100000:0.0:1789120995.076778:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:12668:x1876028947526912:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120995.076809:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120995.076861:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a83100d2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ecb0 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.076967:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a83100d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.076994:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a83100d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.077010:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a83100d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120995.077073:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789120995.077102:0:6518:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a83100d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.077136:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a83100d2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb0 expref: 41 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.077155:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a83100d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb0 expref: 40 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.077164:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:0.0:1789120995.077167:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789120995.077171:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23800, rc 0) 00000100:00100000:0.0:1789120995.077259:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+40:12668:x1876028947526912:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 485us (13776us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120995.077268:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 196 00000100:00100000:2.0:1789120995.085247:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120995.085388:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947527040 00000100:00100000:3.0:1789120995.085401:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947527040 00000100:00100000:3.0:1789120995.085483:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:3.0:1789120995.085495:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947527040:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120995.085523:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120995.085553:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83100e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ecb7 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120995.085586:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3d1e2, blocks: 0x0 00010000:00010000:3.0:1789120995.085615:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=445s v=(0 0) 00010000:00010000:3.0:1789120995.085620:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120995.085632:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83100e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb7 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.085652:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83100e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb7 expref: 8 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.085680:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54c00, rc 0) 00000100:00100000:3.0:1789120995.085769:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2411:x1876028947527040:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 276us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120995.085778:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:3.0:1789120995.110928:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120995.114066:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947527296 00000100:00100000:3.0:1789120995.114101:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947527296 00000100:00100000:3.0:1789120995.114190:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 197 00000100:00100000:3.0:1789120995.114204:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+40:12668:x1876028947527296:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789120995.114374:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783bce940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+40:12668:x1876028947527296:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 172us (3462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120995.114385:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 197 00000100:00100000:3.0:1789120995.123199:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120995.123532:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947527424 00000100:00100000:0.0:1789120995.123545:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947527424 00000100:00100000:0.0:1789120995.123617:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:0.0:1789120995.123630:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:12668:x1876028947527424:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120995.123655:0:9116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120995.123706:0:9116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ecbe expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.123748:0:9116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83100e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb7 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.125349:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120995.125356:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120995.125371:0:9116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 9 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.125437:0:9116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83100e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb7 expref: 9 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.125458:0:9116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83100e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb7 expref: 9 pid: 8434 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120995.125478:0:9116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893845a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9116:1876028970664064:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120995.125620:0:9116:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120995.129368:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120995.129418:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947527552 00000100:00100000:2.0:1789120995.129428:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947527552 00010000:00010000:2.0:1789120995.129488:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83100e0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb7 expref: 10 pid: 8434 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120995.129548:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00100000:2.0:1789120995.129559:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:2411:x1876028947527552:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120995.129583:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120995.129612:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83100e0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb7 expref: 10 pid: 8434 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.129628:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83100e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb7 expref: 10 pid: 8434 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.129696:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120995.129702:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120995.129712:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 10 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.129725:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 10 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.129793:0:6504:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 10 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120995.129811:0:6504:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1876028970664192:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789120995.129934:0:6504:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7c00 going to sleep for 11 seconds 00010000:00010000:3.0:1789120995.141585:0:9116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83100e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb7 expref: 10 pid: 8434 timeout: 545 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120995.141617:0:9116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893845a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9116:1876028970664064:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120995.142121:0:9116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 9 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.142144:0:9116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22800, rc 0) 00000100:00100000:2.0:1789120995.145163:0:6504:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914df480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6504:1876028970664192:192.168.202.32@tcp:105: 00010000:00010000:2.0:1789120995.145203:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120995.145735:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2411:x1876028947527552:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 15715us (15922us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120995.145804:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 101 00000100:00100000:0.0:1789120995.151401:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:12668:x1876028947527424:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 27750us (28192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120995.151420:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:2.0:1789120995.171310:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120995.174308:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947527680 00000100:00100000:3.0:1789120995.174332:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947527680 00002000:00100000:0.0:1789120995.175775:0:8439:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9468914df480 x1876028947527680/t0(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:526/0 lens 504/0 e 0 to 0 dl 1789121006 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120995.175792:0:8439:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468914df480 with x1876028947527680 ext(0->8) 00002000:00010000:0.0:1789120995.175800:0:8439:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468914df480 00000100:00100000:0.0:1789120995.175875:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:0.0:1789120995.175888:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947527680:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789120995.177133:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:2412:x1876028947527680:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 Request processed in 1239us (5831us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789120995.177148:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00002000:00100000:0.0:1789120995.177158:0:8439:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9468914df480 x1876028947527680/t4294967315(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:526/0 lens 504/448 e 0 to 0 dl 1789121006 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120995.177169:0:8439:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468914df480 with x1876028947527680 ext(0->8) 00002000:00010000:0.0:1789120995.177174:0:8439:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468914df480 00000100:00100000:2.0:1789120995.179865:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120995.180111:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947527808 00000100:00100000:3.0:1789120995.180124:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947527808 00000100:00100000:3.0:1789120995.180208:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 198 00000100:00100000:3.0:1789120995.180222:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+40:12668:x1876028947527808:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789120995.187340:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:0.0:1789120995.187364:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00010000:00010000:3.0:1789120995.187437:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187451:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187473:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187480:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120995.187485:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187493:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187515:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:3.0:1789120995.187519:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120995.187524:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187532:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a830ff7b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187554:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187560:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187566:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187571:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120995.187574:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187588:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187598:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:3.0:1789120995.187600:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120995.187603:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187610:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a830ffc1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187624:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187629:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187636:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187640:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3aa00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120995.187643:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187650:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187670:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:3.0:1789120995.187673:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789120995.187676:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.187691:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a83100c4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120995.189019:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970664320:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789120995.189121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789120995.193022:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:0.0:1789120995.193254:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:12668:x1876028947527808:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 Request processed in 13026us (13396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120995.193270:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 198 00000020:00080000:1.0:1789120995.194096:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1789120995.194115:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789120995.194391:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970664320 00000100:00100000:0.0:1789120995.194403:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970664320 00000100:00100000:0.0:1789120995.194483:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789120995.194495:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970664320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789120995.194817:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789120995.194848:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789120994 00002000:00010000:0.0:1789120995.194852:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789120995.194854:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789120994 -> 1789120994 00002000:00010000:0.0:1789120995.194857:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00080000:1.0:1789120995.195042:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120995.200875:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970664320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 6367us (11739us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789120995.200976:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000004:00080000:3.0:1789120995.201371:0:3647:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9468914de580/2, rc 0, transno 4294967316 00000100:00100000:3.0:1789120995.201380:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970664320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789120995.208969:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120995.209173:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947527936 00000100:00100000:2.0:1789120995.209188:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947527936 00000100:00100000:2.0:1789120995.209273:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:2.0:1789120995.209286:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893845a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:2411:x1876028947527936:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1789120995.212396:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:2.0:1789120995.212410:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1789120995.212594:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893845a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947527936:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 Request processed in 3303us (3634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120995.212609:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:3.0:1789120995.216364:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120995.216512:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947528192 00000100:00100000:2.0:1789120995.216524:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947528192 00000100:00100000:2.0:1789120995.216605:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 199 00000100:00100000:2.0:1789120995.216618:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:12668:x1876028947528192:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789120995.216714:0:9342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120995.217033:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a83100d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecb0 expref: 19 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.217060:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:2.0:1789120995.217067:0:9342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120995.217114:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.217132:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.217145:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120995.217316:0:9342:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000d804d3c4 reply state 0000000042b2fda5 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.217331:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.217337:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:2.0:1789120995.217340:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789120995.217365:0:9342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120995.217713:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:12668:x1876028947528192:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 1094us (1362us total) trans 4294967463 rc 0/0 00000100:00100000:2.0:1789120995.217724:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 199 00000100:00100000:1.0:1789120995.237086:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120995.237231:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947528320 00000100:00100000:2.0:1789120995.237243:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947528320 00000100:00100000:2.0:1789120995.237310:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:2.0:1789120995.237321:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947528320:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789120995.237632:0:8433:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789120995.237636:0:8433:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789120994 -> 1789120993 00002000:00010000:2.0:1789120995.237640:0:8433:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1789120991 00002000:00010000:2.0:1789120995.237641:0:8433:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789120994 -> 1789120993 00002000:00010000:2.0:1789120995.237643:0:8433:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:2.0:1789120995.237862:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2411:x1876028947528320:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 541us (792us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789120995.237873:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:3.0:1789120995.247215:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120995.247324:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947528576 00000100:00100000:0.0:1789120995.247337:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947528576 00000100:00100000:0.0:1789120995.247428:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 200 00000100:00100000:0.0:1789120995.247441:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:12668:x1876028947528576:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789120995.247538:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.247559:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83100bd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca2 expref: 20 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.247572:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.247615:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83100bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca2 expref: 20 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.247630:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83100bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca2 expref: 20 pid: 11088 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120995.247647:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eacb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970664448:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120995.247778:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237780 going to sleep for 11 seconds 00000100:00100000:2.0:1789120995.262155:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eacb40 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970664448:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120995.262204:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120995.264056:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120995.264293:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947528704 00000100:00100000:1.0:1789120995.264306:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947528704 00010000:00010000:1.0:1789120995.264367:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83100bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca2 expref: 21 pid: 11088 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120995.264425:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 102 00000100:00100000:1.0:1789120995.264437:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:2411:x1876028947528704:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120995.264457:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120995.264466:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83100bd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca2 expref: 21 pid: 11088 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120995.264479:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83100bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca2 expref: 21 pid: 11088 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120995.264506:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83100bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca2 expref: 21 pid: 11088 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120995.264525:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:1.0:1789120995.264531:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120995.264562:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120995.264571:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120995.264606:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120995.264681:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:2411:x1876028947528704:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 244us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120995.264690:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 102 00010000:00010000:3.0:1789120995.265174:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.265185:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.265243:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.265251:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.265258:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.265264:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120995.265278:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.265287:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.265299:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:3.0:1789120995.265302:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789120995.265305:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.265311:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a83100f5 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120995.265473:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:12668:x1876028947528576:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 Request processed in 18032us (18271us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789120995.265484:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 200 00000100:00100000:3.0:1789120995.282180:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120995.282275:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947528832 00000100:00100000:0.0:1789120995.282288:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947528832 00000100:00100000:0.0:1789120995.282364:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:0.0:1789120995.282387:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947528832:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789120995.282467:0:9116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.282492:0:9116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 8 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.282501:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120995.282506:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789120995.282512:0:9116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 4/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.282557:0:9116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 8 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.282572:0:9116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 8 pid: 9116 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120995.282588:0:9116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eacb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9116:1876028970664576:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120995.282712:0:9116:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120995.289096:0:9116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eacb40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9116:1876028970664576:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120995.289143:0:9116:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 3/1,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120995.289622:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120995.291099:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947528960 00000100:00100000:3.0:1789120995.291115:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947528960 00010000:00010000:3.0:1789120995.291179:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 9 pid: 9116 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120995.291236:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 103 00000100:00100000:3.0:1789120995.291248:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2411:x1876028947528960:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120995.291283:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120995.291314:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 9 pid: 9116 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.291331:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 9 pid: 9116 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.291363:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c346d20/0xb74d2367a83100e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecbe expref: 9 pid: 9116 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.291522:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120995.291529:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120995.291537:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.291550:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.291595:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120995.291677:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2411:x1876028947528960:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 430us (2056us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120995.291687:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 103 00010000:00010000:0.0:1789120995.292227:0:9116:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.292240:0:9116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.292285:0:9116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.292294:0:9116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.292303:0:9116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.292311:0:9116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789120995.292316:0:9116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.292326:0:9116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.292345:0:9116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.292354:0:9116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c908438/0xb74d2367a83100fc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120995.292646:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947528832:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 Request processed in 10268us (10478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120995.292664:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:3.0:1789120995.306440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120995.306603:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947529216 00000100:00100000:2.0:1789120995.306615:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947529216 00000100:00100000:2.0:1789120995.307193:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 201 00000100:00100000:2.0:1789120995.307207:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:12668:x1876028947529216:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789120995.307324:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.307364:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff4a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec47 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.307742:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.307802:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec47 expref: 19 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.308633:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec47 expref: 19 pid: 6519 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120995.309312:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970664704:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120995.309620:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789120995.319177:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dc780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970664704:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120995.319222:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120995.332048:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120995.332141:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947529344 00000100:00100000:2.0:1789120995.332153:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947529344 00010000:00010000:2.0:1789120995.332206:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec47 expref: 20 pid: 6519 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120995.332255:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 104 00000100:00100000:2.0:1789120995.332265:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:2411:x1876028947529344:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120995.332284:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120995.332305:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff4a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec47 expref: 20 pid: 6519 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.332320:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff4a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec47 expref: 20 pid: 6519 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.332350:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a830ff4a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec47 expref: 20 pid: 6519 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.332368:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:2.0:1789120995.332387:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.332401:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.332411:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.332447:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120995.332514:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:2411:x1876028947529344:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 250us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120995.332523:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 104 00010000:00010000:3.0:1789120995.333253:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.333280:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.333500:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.333516:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83100cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca9 expref: 19 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.333525:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.333567:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83100cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca9 expref: 19 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.333585:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83100cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca9 expref: 19 pid: 9342 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120995.333602:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970664832:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120995.335240:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108ab40 going to sleep for 11 seconds 00000100:00100000:2.0:1789120995.341079:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c780 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970664832:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120995.341123:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120995.341261:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120995.345122:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947529472 00000100:00100000:2.0:1789120995.345145:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947529472 00010000:00010000:2.0:1789120995.345213:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83100cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca9 expref: 20 pid: 9342 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120995.345481:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 105 00000100:00100000:2.0:1789120995.345496:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:2412:x1876028947529472:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120995.345516:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120995.345524:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83100cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca9 expref: 20 pid: 9342 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.345541:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83100cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca9 expref: 20 pid: 9342 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.345573:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83100cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eca9 expref: 20 pid: 9342 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.345595:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:2.0:1789120995.345602:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.345614:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.345623:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.345671:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120995.345765:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:2412:x1876028947529472:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 272us (4505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120995.345775:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 105 00010000:00010000:0.0:1789120995.345849:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.345859:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120995.346031:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1789120995.346185:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:0.0:1789120995.346227:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1789120995.346333:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eacb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1876028970664960:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789120995.346432:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120995.346483:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237180 going to sleep for 11 seconds 00000100:00100000:0.0:1789120995.346515:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970664960 00000100:00100000:0.0:1789120995.346522:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970664960 00000100:00100000:0.0:1789120995.346567:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789120995.346576:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876028970664960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789120995.346669:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf707c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6520:x1876028970664960:12345-0@lo:1000:mdt00_002.0 Request processed in 94us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120995.346677:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:0.0:1789120995.346723:0:6520:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1789120995.346731:0:6520:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9468914de580, transno 4294967316 00000100:00100000:0.0:1789120995.346747:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eacb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1876028970664960:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789120995.346937:0:6520:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:0.0:1789120995.346986:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf704f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1876028970665088:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789120995.347017:0:6520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120995.347038:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120995.351235:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970665088 00000100:00100000:3.0:1789120995.351254:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970665088 00000100:00100000:3.0:1789120995.351332:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1789120995.351345:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6520:x1876028970665088:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789120995.351632:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6520:x1876028970665088:12345-0@lo:1000:mdt00_002.0 Request processed in 289us (4614us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789120995.351765:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789120995.353387:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf704f00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:6520:1876028970665088:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789120995.353469:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353500:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353508:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353515:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120995.353521:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353531:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353552:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:0.0:1789120995.353555:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789120995.353562:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353569:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a831010a lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353603:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310046 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353610:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310046 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353616:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310046 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353620:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3ba00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120995.353629:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310046 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353636:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310046 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353645:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:0.0:1789120995.353648:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789120995.353651:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310046 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353844:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310046 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353881:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353909:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec8d expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353920:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353974:0:6520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec8d expref: 22 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.353993:0:6520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec8d expref: 22 pid: 6518 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120995.354010:0:6520:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468a2eacb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970665216:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120995.354144:0:6520:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789120995.359537:0:6520:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468a2eacb40 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6520:1876028970665216:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120995.359582:0:6520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120995.359947:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120995.361624:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947529600 00000100:00100000:3.0:1789120995.361640:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947529600 00010000:00010000:3.0:1789120995.361709:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec8d expref: 23 pid: 6518 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120995.361798:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00100000:3.0:1789120995.361809:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:2411:x1876028947529600:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120995.361849:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120995.361858:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec8d expref: 23 pid: 6518 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.361873:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec8d expref: 23 pid: 6518 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.362467:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310062 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ec8d expref: 23 pid: 6518 timeout: 545 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.362487:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:3.0:1789120995.362494:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.362506:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.362525:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.362574:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120995.362766:0:6520:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362778:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362796:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362804:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362812:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362842:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120995.362849:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362858:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362870:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:0.0:1789120995.362873:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120995.362877:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362884:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310111 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362907:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362915:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362929:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362937:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3b400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120995.362940:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362946:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362954:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468a3998f00) 00010000:00010000:0.0:1789120995.362957:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789120995.362960:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120995.362965:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a8310103 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789120995.363331:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789120995.363339:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789120995.363859:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789120995.363874:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789120995.364004:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:2411:x1876028947529600:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 2189us (4052us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120995.364019:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 106 00000100:00100000:0.0:1789120995.365150:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:12668:x1876028947529216:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 57936us (58713us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1789120995.365168:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 201 00000020:00080000:0.0:1789120995.365175:0:6520:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1789120995.381441:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120995.381551:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947529856 00000100:00100000:3.0:1789120995.381564:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947529856 00000100:00100000:3.0:1789120995.381647:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:3.0:1789120995.381669:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:12668:x1876028947529856:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789120995.382233:0:6522:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789120995.382279:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:3.0:1789120995.382322:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310118 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.382344:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310118 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.382359:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310118 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.382369:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310118 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.382377:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310118 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.382383:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310118 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120995.382467:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789120995.382606:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913fe450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:12668:x1876028947529856:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 937us (1174us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789120995.382617:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00000020:00080000:3.0:1789120995.382623:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789120995.388617:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789120995.388639:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310118 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.388666:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789120995.388671:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310118 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.388684:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310118 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.388708:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:2.0:1789120995.388712:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789120995.388718:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310118 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.388724:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310118 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120995.388745:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120995.388747:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789120995.388968:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789120995.731470:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789120995.731506:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970665344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789120995.731622:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120995.732048:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789120995.732063:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970665472:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789120995.732101:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120995.734062:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970665344 00000100:00100000:3.0:1789120995.734079:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970665344 00000100:00100000:3.0:1789120995.734164:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970665472 00000100:00100000:3.0:1789120995.734168:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970665472 00000100:00100000:3.0:1789120995.734193:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789120995.734204:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970665344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789120995.734256:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789120995.734366:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970665344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 162us (2744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120995.734374:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:3.0:1789120995.734398:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1789120995.734405:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970665472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789120995.734426:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789120995.734470:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eacb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970665472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120995.734477:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789120995.734604:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970665344:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789120995.734726:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970665472:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789120996.050236:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789120996.773866:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1789120996.773900:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00010000:00010000:2.0:1789120997.082475:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789120997.202569:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1789120997.249074:0:15421:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789120997.249086:0:15421:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789120997.249120:0:15421:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789120997.249129:0:15421:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789120997.394846:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789120997.394860:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789120997.394895:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789120997.394911:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789120997.432616:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120997.432755:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947530112 00000100:00100000:1.0:1789120997.432769:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947530112 00000100:00100000:1.0:1789120997.433037:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 202 00000100:00100000:1.0:1789120997.433049:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:12687:x1876028947530112:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789120997.433086:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120997.433115:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831011f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ecc5 expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.433294:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310126 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.433312:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310126 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.433326:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310126 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120997.433359:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1789120997.433500:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831011f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecc5 expref: 26 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.433519:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310126 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecc5 expref: 25 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.433530:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:1.0:1789120997.433533:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789120997.433539:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3000, rc 0) 00000100:00100000:1.0:1789120997.433622:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782b3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+25:12687:x1876028947530112:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 574us (1021us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789120997.433631:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 202 00000100:00080000:0.0:1789120997.434038:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789120997.445179:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120997.446275:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947530240 00000100:00100000:0.0:1789120997.446292:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947530240 00000100:00100000:0.0:1789120997.446385:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 203 00000100:00100000:0.0:1789120997.446398:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+25:12687:x1876028947530240:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:0.0:1789120997.446513:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310134 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446536:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310134 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446551:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310134 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446571:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a831013b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446579:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a831013b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446586:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a831013b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446698:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a8310142 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446707:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a8310142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446715:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a8310142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789120997.446810:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a8310142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446846:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310134 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446854:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310134 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446861:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310134 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446868:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120997.446874:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310134 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446892:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310134 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446908:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:0.0:1789120997.446911:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120997.446918:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310134 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446926:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310134 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446942:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a831013b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446948:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a831013b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446961:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a831013b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446966:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120997.446969:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a831013b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446976:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a831013b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446985:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468c1bd2800) 00010000:00010000:0.0:1789120997.446987:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120997.446990:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a831013b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.446996:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a831013b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.447015:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a8310142 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.447021:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a8310142 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.447026:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a8310142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.447032:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120997.447034:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a8310142 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.447051:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a8310142 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.447060:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468c1bd2300) 00010000:00010000:0.0:1789120997.447063:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120997.447065:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a8310142 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120997.447071:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a8310142 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120997.447182:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+25:12687:x1876028947530240:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 784us (2016us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120997.447192:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 203 00000100:00100000:0.0:1789120997.516047:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.516185:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947530496 00000100:00100000:3.0:1789120997.516217:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947530496 00000100:00100000:3.0:1789120997.516318:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 204 00000100:00100000:3.0:1789120997.516330:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+25:12690:x1876028947530496:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120997.516381:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120997.516419:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310149 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eccc expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.516547:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310150 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.516575:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310150 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.516599:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310150 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.516618:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310157 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.516626:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.516639:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.516850:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a831015e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.516859:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a831015e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.516867:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a831015e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120997.516892:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789120997.517021:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310150 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517035:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310150 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517043:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310150 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517050:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120997.517055:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310150 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517068:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310150 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517084:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789120997.517088:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120997.517099:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310150 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517106:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a8310150 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517119:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310157 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517125:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310157 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517132:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517143:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120997.517153:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310157 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517160:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310157 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517174:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468886f6c00) 00010000:00010000:3.0:1789120997.517176:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120997.517180:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310157 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517186:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310157 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517252:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310149 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eccc expref: 28 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517268:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a831015e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eccc expref: 27 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.517277:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:3.0:1789120997.517280:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789120997.517283:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55a00, rc 0) 00000100:00100000:3.0:1789120997.517372:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12690:x1876028947530496:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1044us (1340us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789120997.517382:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 204 00000100:00100000:2.0:1789120997.522780:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.522951:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947530624 00000100:00100000:3.0:1789120997.522965:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947530624 00000100:00100000:3.0:1789120997.523047:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 205 00000100:00100000:3.0:1789120997.523060:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf701680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12690:x1876028947530624:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:3.0:1789120997.523178:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831016c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.523202:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831016c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.523215:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831016c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.523262:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831016c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.523269:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831016c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.523276:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831016c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.523282:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120997.523288:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831016c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.523297:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831016c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.523312:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:3.0:1789120997.523316:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789120997.523321:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831016c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.523328:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a831016c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120997.523442:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf701680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12690:x1876028947530624:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 384us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120997.523451:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 205 00000100:00100000:2.0:1789120997.533875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.536100:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947530880 00000100:00100000:3.0:1789120997.536122:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947530880 00000100:00100000:3.0:1789120997.536204:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:3.0:1789120997.536214:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12690:x1876028947530880:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789120997.536481:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+28:12690:x1876028947530880:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 267us (2662us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789120997.536490:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:2.0:1789120997.576411:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120997.576464:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947531136 00000100:00100000:2.0:1789120997.576477:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947531136 00000100:00100000:2.0:1789120997.576546:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 206 00000100:00100000:2.0:1789120997.576558:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+28:12214:x1876028947531136:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789120997.576593:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120997.576622:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310173 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ecd3 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.576973:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.576992:0:11088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a831015e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eccc expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.577003:0:11088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.577073:0:11088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a831015e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eccc expref: 29 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.577089:0:11088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a831015e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eccc expref: 29 pid: 6520 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120997.577107:0:11088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d183c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970665600:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120997.577225:0:11088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7000 going to sleep for 11 seconds 00000100:00100000:0.0:1789120997.583483:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120997.584050:0:11088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d183c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970665600:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120997.584091:0:11088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120997.584341:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947531264 00000100:00100000:2.0:1789120997.584352:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947531264 00010000:00010000:2.0:1789120997.584411:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a831015e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eccc expref: 30 pid: 6520 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120997.584466:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 107 00000100:00100000:2.0:1789120997.584478:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:2411:x1876028947531264:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120997.584496:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120997.584505:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a831015e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eccc expref: 30 pid: 6520 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.584519:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a831015e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eccc expref: 30 pid: 6520 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.584549:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55a00/0xb74d2367a831015e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eccc expref: 30 pid: 6520 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.584569:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:2.0:1789120997.584581:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.584593:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.584601:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.584628:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120997.584705:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:2411:x1876028947531264:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 228us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120997.584714:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 107 00010000:00010000:2.0:1789120997.585506:0:11088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.585519:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120997.585543:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789120997.585721:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a8310173 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecd3 expref: 30 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.585755:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecd3 expref: 29 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.585777:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:2.0:1789120997.585780:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789120997.585785:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3b800, rc 0) 00000100:00100000:2.0:1789120997.585859:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:12214:x1876028947531136:12345-192.168.202.32@tcp:101:bash.0 Request processed in 9303us (9464us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1789120997.586068:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 206 00000100:00100000:1.0:1789120997.592209:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120997.592255:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947531392 00000100:00100000:1.0:1789120997.592268:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947531392 00000100:00100000:1.0:1789120997.592348:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 207 00000100:00100000:1.0:1789120997.592360:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:12214:x1876028947531392:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789120997.592395:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120997.592423:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310188 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ecda expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.592487:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a831018f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.592507:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a831018f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.592522:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a831018f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.592759:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310188 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecda expref: 31 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.592778:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a831018f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecda expref: 30 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.592787:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:1.0:1789120997.592791:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789120997.592796:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3c00, rc 0) 00000100:00100000:1.0:1789120997.592899:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:12214:x1876028947531392:12345-192.168.202.32@tcp:101:bash.0 Request processed in 541us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120997.592908:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 207 00000100:00100000:1.0:1789120997.596590:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.596738:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947531648 00000100:00100000:3.0:1789120997.596749:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947531648 00000100:00100000:3.0:1789120997.596841:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 208 00000100:00100000:3.0:1789120997.596853:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:12214:x1876028947531648:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:3.0:1789120997.597166:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.597188:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.597199:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789120997.597247:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:3.0:1789120997.597269:0:6518:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000f12bbd73 reply state 00000000196c1479 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.597298:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.597306:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:3.0:1789120997.597309:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789120997.597313:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789120997.597351:0:6518:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:3.0:1789120997.597471:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12214:x1876028947531648:12345-192.168.202.32@tcp:36:bash.0 Request processed in 619us (896us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1789120997.597479:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 208 00000020:00080000:3.0:1789120997.597485:0:6518:0:(tgt_main.c:785:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789120997.601517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120997.601710:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947531776 00000100:00100000:1.0:1789120997.601723:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947531776 00000100:00100000:1.0:1789120997.601860:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 209 00000100:00100000:1.0:1789120997.601873:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+34:12214:x1876028947531776:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789120997.601907:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120997.602022:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a831019d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ece1 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.602103:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a831019d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece1 expref: 35 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.602121:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a831019d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece1 expref: 35 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.602145:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:1.0:1789120997.602148:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789120997.602153:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2600, rc 0) 00000100:00100000:1.0:1789120997.602235:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12214:x1876028947531776:12345-192.168.202.32@tcp:101:bash.0 Request processed in 364us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120997.602243:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 209 00000100:00100000:1.0:1789120997.606464:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.606535:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947531904 00000100:00100000:3.0:1789120997.606549:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947531904 00000100:00080000:0.0:1789120997.606639:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789120997.606683:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:3.0:1789120997.606696:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:12214:x1876028947531904:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:3.0:1789120997.606720:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120997.606763:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83101a4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ece8 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789120997.606804:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3d1e1, atime: 0x6aa3d1df, ctime: 0x6aa3d1e1, blocks: 0x8 00010000:00010000:3.0:1789120997.606867:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=447s v=(0 0) 00010000:00010000:3.0:1789120997.606874:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120997.606897:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83101a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece8 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.606920:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83101a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece8 expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.606960:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54c00, rc 0) 00000100:00100000:3.0:1789120997.607060:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:12214:x1876028947531904:12345-192.168.202.32@tcp:101:bash.0 Request processed in 366us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120997.607067:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:2.0:1789120997.609713:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120997.610202:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947532032 00000100:00100000:1.0:1789120997.610213:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947532032 00002000:00010000:1.0:1789120997.610274:0:8440:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1789120997.610278:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff946783d1b840 with x1876028947532032 ext(0->18446744073709551615) 00002000:00010000:1.0:1789120997.610293:0:8440:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946783d1b840. 00000100:00100000:1.0:1789120997.610325:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:1.0:1789120997.610337:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947532032:12345-192.168.202.32@tcp:10:bash.0 00002000:00010000:1.0:1789120997.610661:0:8440:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1789120997.610665:0:8440:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 1789120993 -> 1789120997 00002000:00010000:1.0:1789120997.610667:0:8440:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 1789120991 -> 1789120991 00002000:00010000:1.0:1789120997.610669:0:8440:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 1789120993 -> 1789120997 00002000:00010000:1.0:1789120997.610685:0:8440:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:1.0:1789120997.611070:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2412:x1876028947532032:12345-192.168.202.32@tcp:10:bash.0 Request processed in 732us (1433us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1789120997.611081:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00002000:00010000:1.0:1789120997.611086:0:8440:0:(ofd_dev.c:2842:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 10737419265/5 (0->18446744073709551615) 00002000:00100000:1.0:1789120997.611089:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff946783d1b840 with x1876028947532032 ext(0->18446744073709551615) 00002000:00010000:1.0:1789120997.611095:0:8440:0:(ofd_dev.c:2847:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff946783d1b840. 00000100:00100000:2.0:1789120997.675718:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120997.675902:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947532160 00000100:00100000:1.0:1789120997.675925:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947532160 00000100:00100000:1.0:1789120997.676008:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 210 00000100:00100000:1.0:1789120997.676020:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b6a2c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12704:x1876028947532160:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:1.0:1789120997.676113:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101ab lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676131:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676142:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676156:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101b2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676161:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676165:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676256:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101b9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676281:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676285:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120997.676335:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676346:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101ab lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676351:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101ab lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676356:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676360:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120997.676363:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101ab lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676369:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101ab lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676378:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:1.0:1789120997.676381:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120997.676385:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101ab lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676389:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101ab lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676405:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101b2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676409:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101b2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676413:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676416:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120997.676417:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101b2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676420:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101b2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676424:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bff00) 00010000:00010000:1.0:1789120997.676426:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120997.676427:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101b2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676430:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101b2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676441:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101b9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676444:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101b9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676447:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676454:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120997.676456:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101b9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676460:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101b9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676464:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:1.0:1789120997.676465:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120997.676467:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101b9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.676470:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101b9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120997.676563:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b6a2c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12704:x1876028947532160:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 543us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120997.676571:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 210 00000100:00100000:0.0:1789120997.734083:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.734187:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947532416 00000100:00100000:3.0:1789120997.734199:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947532416 00000100:00100000:3.0:1789120997.734277:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 211 00000100:00100000:3.0:1789120997.734286:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+35:12707:x1876028947532416:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120997.734310:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120997.734334:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a83101c0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ecef expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.734415:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83101c7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.734429:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83101c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.734438:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83101c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.734448:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a83101ce lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.734452:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a83101ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.734456:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a83101ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.734604:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a83101d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.734613:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a83101d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.734618:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a83101d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120997.734627:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789120997.735108:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83101c7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735116:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83101c7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735121:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83101c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735125:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120997.735129:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83101c7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735135:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83101c7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735146:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789120997.735148:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120997.735152:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83101c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735165:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83101c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735178:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a83101ce lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735181:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a83101ce lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735185:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a83101ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735188:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789120997.735190:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a83101ce lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735193:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a83101ce lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735197:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468886f6e00) 00010000:00010000:3.0:1789120997.735199:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789120997.735200:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a83101ce lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735203:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a83101ce lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735283:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a83101c0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecef expref: 38 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735298:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a83101d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecef expref: 37 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120997.735312:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:3.0:1789120997.735314:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789120997.735317:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55e00, rc 0) 00000100:00100000:3.0:1789120997.735405:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:12707:x1876028947532416:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1118us (1337us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789120997.735414:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 211 00000100:00100000:2.0:1789120997.741049:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120997.741211:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947532544 00000100:00100000:1.0:1789120997.741224:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947532544 00000100:00100000:1.0:1789120997.741306:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 212 00000100:00100000:1.0:1789120997.741317:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:12707:x1876028947532544:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:1.0:1789120997.741433:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.741453:0:11088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecd3 expref: 37 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.741464:0:11088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.741533:0:11088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecd3 expref: 37 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.741548:0:11088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecd3 expref: 37 pid: 11088 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120997.741564:0:11088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970665728:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789120997.741682:0:11088:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19240 going to sleep for 11 seconds 00000100:00100000:1.0:1789120997.745249:0:11088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970665728:192.168.202.32@tcp:104: 00010000:00010000:1.0:1789120997.745292:0:11088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120997.746496:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.746590:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947532800 00000100:00100000:3.0:1789120997.746599:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947532800 00000100:00100000:3.0:1789120997.746658:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:3.0:1789120997.746666:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:6183:x1876028947532800:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789120997.752565:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:6183:x1876028947532800:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 5875us (6056us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789120997.752585:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:2.0:1789120997.753490:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120997.753613:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947532928 00000100:00100000:1.0:1789120997.753626:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947532928 00010000:00010000:1.0:1789120997.753753:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecd3 expref: 39 pid: 11088 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120997.754066:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 108 00000100:00100000:1.0:1789120997.754079:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:2411:x1876028947532928:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120997.754102:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120997.754111:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecd3 expref: 39 pid: 11088 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.754127:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecd3 expref: 39 pid: 11088 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.754191:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a831017a lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecd3 expref: 39 pid: 11088 timeout: 547 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.754211:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:1.0:1789120997.754219:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.754239:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.754248:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.754292:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120997.754346:0:11088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.754356:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120997.754388:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:2411:x1876028947532928:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 312us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120997.754397:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 108 00010000:00010000:2.0:1789120997.754420:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.754428:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.754436:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.754443:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120997.754449:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.754457:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.754468:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:2.0:1789120997.754478:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789120997.754483:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120997.754490:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83101e3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120997.754540:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:12707:x1876028947532544:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 13224us (13506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120997.754549:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 212 00000100:00100000:0.0:1789120997.757430:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120997.757796:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947533184 00000100:00100000:2.0:1789120997.757813:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947533184 00000100:00100000:2.0:1789120997.758055:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:2.0:1789120997.758068:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+37:12707:x1876028947533184:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:2.0:1789120997.758405:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:12707:x1876028947533184:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 339us (988us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1789120997.758415:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:3.0:1789120997.778513:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789120997.778546:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970665856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789120997.778661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120997.779109:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970665984:0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.779149:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120997.779181:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970666496:0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.779212:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120997.779229:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970667008:0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.779257:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120997.779276:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789120997.779282:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970666368:0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.779329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120997.779346:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970666880:0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.779372:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120997.779390:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970667392:0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.779412:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120997.779444:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970665984 00000100:00100000:3.0:1789120997.779452:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970665984 00000100:00100000:3.0:1789120997.779507:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1789120997.779517:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970665984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.779576:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970665984:12345-0@lo:400:kworker.0 Request processed in 60us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120997.779583:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 463 00000100:00100000:3.0:1789120997.779996:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970666496 00000100:00100000:3.0:1789120997.780001:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970666496 00000100:00100000:3.0:1789120997.780031:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789120997.780038:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970666496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.780079:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970666496:12345-0@lo:400:kworker.0 Request processed in 41us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120997.780085:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1789120997.780105:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970666880 00000100:00100000:3.0:1789120997.780108:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970666880 00000100:00100000:3.0:1789120997.780143:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970667392 00000100:00100000:3.0:1789120997.780146:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970667392 00000100:00100000:3.0:1789120997.780168:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789120997.780174:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970666880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.780205:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970666880:12345-0@lo:400:kworker.0 Request processed in 32us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120997.780223:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789120997.780253:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789120997.780259:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970667392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.780290:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970667392:12345-0@lo:400:kworker.0 Request processed in 31us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120997.780295:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789120997.780339:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970666880:0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.780350:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967308 gen 2 00000004:00080000:3.0:1789120997.780356:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967308 00000004:00080000:3.0:1789120997.780396:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9467848f9680, transno 4294967308 00000100:00100000:3.0:1789120997.780408:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970667392:0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.780420:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970665984:0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.780429:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970666496:0@lo:400:kworker.0 00000100:00100000:1.0:1789120997.780552:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970665856 00000100:00100000:1.0:1789120997.780557:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970665856 00000100:00100000:1.0:1789120997.780601:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789120997.780609:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970665856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789120997.780650:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1789120997.780711:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970665856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (2051us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120997.780717:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789120997.780770:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970665856:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789120997.781268:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970666240:0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.781333:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120997.781369:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970666752:0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.781401:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120997.781424:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970667264:0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.781449:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120997.781472:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1789120997.781479:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970666112:0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.781501:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120997.781518:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970666624:0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.781557:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120997.781576:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970667136:0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.781598:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120997.782126:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970666240 00000100:00100000:0.0:1789120997.782131:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789120997.782134:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970666240 00000100:00100000:0.0:1789120997.782144:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970667520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789120997.782184:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120997.782195:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1789120997.782204:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970666240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120997.782235:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970667264 00000100:00100000:0.0:1789120997.782240:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970667264 00000100:00100000:2.0:1789120997.782271:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970666240:12345-0@lo:400:kworker.0 Request processed in 68us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120997.782278:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789120997.782279:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:0.0:1789120997.782285:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970667264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.782304:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970667008 00000100:00100000:2.0:1789120997.782308:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970667008 00000100:00100000:0.0:1789120997.782318:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970667264:12345-0@lo:400:kworker.0 Request processed in 34us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120997.782333:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970666368 00000100:00100000:2.0:1789120997.782336:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970666368 00000100:00100000:0.0:1789120997.782337:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789120997.782346:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970666752 00000100:00100000:2.0:1789120997.782349:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970666752 00000100:00100000:2.0:1789120997.782362:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970666112 00000100:00100000:2.0:1789120997.782364:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970666112 00000100:00080000:0.0:1789120997.782368:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789120997.782372:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789120997.782375:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789120997.782378:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789120997.782581:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970667520 00000100:00100000:0.0:1789120997.782585:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970667520 00000100:00100000:2.0:1789120997.782588:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970666624 00000100:00100000:2.0:1789120997.782591:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970666624 00000100:00100000:0.0:1789120997.782611:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789120997.782618:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970667520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789120997.782644:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120997.782683:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970667520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120997.782690:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789120997.782709:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970667648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120997.782750:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120997.782757:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970667136 00000100:00100000:2.0:1789120997.782761:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970667136 00000100:00100000:2.0:1789120997.782779:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1789120997.782786:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970667008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120997.782806:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970667520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789120997.782845:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970667008:12345-0@lo:400:kworker.0 Request processed in 35us (3562us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120997.782852:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1789120997.782853:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970667648 00000100:00100000:0.0:1789120997.782856:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970667648 00000100:00100000:0.0:1789120997.782887:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789120997.782894:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970667648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789120997.782905:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33914560 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1789120997.782938:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970667648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120997.782944:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789120997.782972:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf749e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970667648:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789120997.783003:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789120997.783020:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970666368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120997.783053:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970666368:12345-0@lo:400:kworker.0 Request processed in 35us (3724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120997.783060:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1789120997.783074:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789120997.783081:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970666752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120997.783110:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970666752:12345-0@lo:400:kworker.0 Request processed in 30us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120997.783116:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:0.0:1789120997.783128:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1789120997.783134:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970666112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.783138:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1789120997.783143:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970666624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789120997.783164:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970666112:12345-0@lo:400:kworker.0 Request processed in 30us (1662us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120997.783170:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00000100:00100000:2.0:1789120997.783176:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970666624:12345-0@lo:400:kworker.0 Request processed in 33us (1618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120997.783181:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1789120997.783184:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:0.0:1789120997.783189:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970667136:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789120997.783197:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789120997.783199:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789120997.783215:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970667136:12345-0@lo:400:kworker.0 Request processed in 27us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120997.783221:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1789120997.783376:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970666368:0@lo:400:kworker.0 00000100:00100000:1.0:1789120997.783404:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970667008:0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.783492:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970666112:0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.783505:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970666624:0@lo:400:kworker.0 00010000:00080000:2.0:1789120997.783519:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d1d2c0 x1876028970667136/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120997.783530:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970667136:0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.783542:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970666240:0@lo:400:kworker.0 00010000:00080000:2.0:1789120997.783552:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d1cb40 x1876028970666752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789120997.783562:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970666752:0@lo:400:kworker.0 00000100:00100000:2.0:1789120997.783574:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970667264:0@lo:400:kworker.0 00000100:00100000:3.0:1789120997.841060:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.841117:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.841149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.841197:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.841225:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.841547:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.841572:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120997.841605:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947533312 00000100:00100000:3.0:1789120997.841617:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947533312 00000100:00100000:3.0:1789120997.841684:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 464 00000100:00100000:3.0:1789120997.841696:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947533312:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120997.842156:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947533696 00000100:00100000:0.0:1789120997.842162:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947533696 00000100:00100000:0.0:1789120997.842198:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947533824 00000100:00100000:0.0:1789120997.842201:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947533824 00000100:00100000:0.0:1789120997.842246:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:0.0:1789120997.842255:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2410:x1876028947533696:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789120997.842337:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947533440 00000100:00100000:1.0:1789120997.842343:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947533440 00000100:00100000:1.0:1789120997.842381:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947533952 00000100:00100000:1.0:1789120997.842385:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947533952 00000100:00100000:3.0:1789120997.842402:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2410:x1876028947533312:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 707us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120997.842402:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947533568 00000100:00100000:1.0:1789120997.842405:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947533568 00000100:00100000:3.0:1789120997.842411:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 464 00000100:00100000:1.0:1789120997.842420:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947534080 00000100:00100000:1.0:1789120997.842422:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947534080 00000100:00100000:1.0:1789120997.842438:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 382 00000100:00100000:1.0:1789120997.842444:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:2410:x1876028947533440:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789120997.842471:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 130 00000100:00100000:3.0:1789120997.842479:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947533824:12345-192.168.202.32@tcp:400:kworker.0 00000100:00080000:2.0:1789120997.842622:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789120997.842629:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789120997.842641:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789120997.842665:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 383 00000100:00100000:2.0:1789120997.842676:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947533952:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120997.855143:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2410:x1876028947533696:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 12868us (14003us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120997.855183:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:0.0:1789120997.855301:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 384 00000100:00100000:0.0:1789120997.855321:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947533568:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120997.855409:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947533568:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 98us (14182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120997.855417:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 384 00000100:00100000:0.0:1789120997.855439:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 385 00000100:00100000:0.0:1789120997.855448:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947534080:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789120997.855479:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947534080:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 32us (13906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120997.855486:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 385 00000100:00100000:1.0:1789120997.859377:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:2410:x1876028947533440:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 16913us (18312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120997.859397:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 382 00000100:00100000:3.0:1789120997.863805:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2410:x1876028947533824:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 21307us (22239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120997.864052:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 130 00000100:00100000:2.0:1789120997.867430:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2410:x1876028947533952:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24736us (26259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120997.867453:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 383 00000100:00100000:3.0:1789120997.984737:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120997.984881:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947534336 00000100:00100000:0.0:1789120997.984893:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947534336 00000100:00100000:1.0:1789120997.985276:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 213 00000100:00100000:1.0:1789120997.985293:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+38:12718:x1876028947534336:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:1.0:1789120997.985325:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120997.985354:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101ea lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ecf6 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.985460:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101f1 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.985479:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.985495:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.985537:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a83101f8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.985546:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a83101f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.985553:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a83101f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.985707:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83101ff lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.985719:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83101ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.985917:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83101ff lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120997.985932:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789120997.986039:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101f1 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986048:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101f1 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986057:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986064:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120997.986070:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101f1 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986089:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101f1 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986106:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:1.0:1789120997.986110:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120997.986117:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101f1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986125:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83101f1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986143:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a83101f8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986150:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a83101f8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986158:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a83101f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986164:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120997.986167:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a83101f8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986173:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a83101f8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986181:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bff00) 00010000:00010000:1.0:1789120997.986184:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120997.986187:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a83101f8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986205:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a83101f8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986262:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83101ea lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecf6 expref: 41 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986278:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83101ff lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecf6 expref: 40 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120997.986286:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:1.0:1789120997.986289:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120997.986292:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3400, rc 0) 00000100:00100000:1.0:1789120997.986385:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+40:12718:x1876028947534336:12345-192.168.202.32@tcp:101:cat.0 Request processed in 1096us (1675us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789120997.986395:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 213 00000100:00100000:0.0:1789120998.000309:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120998.000435:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947534592 00000100:00100000:2.0:1789120998.000448:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947534592 00000100:00100000:2.0:1789120998.000527:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:2.0:1789120998.000540:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+40:12718:x1876028947534592:12345-192.168.202.32@tcp:35:cat.0 00000100:00100000:2.0:1789120998.003072:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+41:12718:x1876028947534592:12345-192.168.202.32@tcp:35:cat.0 Request processed in 2519us (2762us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1789120998.003090:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:3.0:1789120998.048267:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120998.048351:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947534848 00000100:00100000:1.0:1789120998.048365:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947534848 00000100:00100000:1.0:1789120998.048448:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 214 00000100:00100000:1.0:1789120998.048460:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+41:12719:x1876028947534848:12345-192.168.202.32@tcp:36:rm.0 00010000:00010000:1.0:1789120998.048544:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:1.0:1789120998.048582:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a831019d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece1 expref: 41 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.048621:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83101ff lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecf6 expref: 40 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.048673:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55e00/0xb74d2367a83101d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecef expref: 39 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.048691:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a831018f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecda expref: 38 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.048703:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:1.0:1789120998.048711:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120998.049378:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a831020d lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.049401:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a831020d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.049416:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a831020d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.049434:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.049442:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.049449:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.049550:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831021b lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.049559:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831021b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.049578:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831021b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789120998.051110:0:6520:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:1.0:1789120998.051137:0:6520:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 448240315436ns, next at 449240309181ns, rc = 0 00010000:00010000:1.0:1789120998.051401:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310222 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051425:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310222 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051439:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310222 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051450:0:6520:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310222 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051457:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310222 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051464:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310222 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051499:0:6520:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789120998.051530:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831021b lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051538:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831021b lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051546:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831021b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051570:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120998.051576:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831021b lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051586:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831021b lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051602:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:1.0:1789120998.051605:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789120998.051621:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831021b lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.051629:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831021b lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.052386:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120998.052398:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310222 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.052408:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789120998.052411:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310222 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40010480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.052419:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310222 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x40018480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.052434:0:6506:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:3.0:1789120998.052436:0:6506:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789120998.052441:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310222 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.052447:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a8310222 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT flags: 0x44819480000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.052492:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120998.052494:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120998.052496:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789120998.052602:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a831020d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.052740:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a831020d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.052748:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a831020d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.052754:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120998.053151:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a831020d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.053162:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a831020d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.053196:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:1.0:1789120998.053199:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120998.053204:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a831020d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.053211:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a831020d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789120998.053698:0:6520:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000009090e752 reply state 00000000a1c417af transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.053720:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.053739:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bff00) 00010000:00010000:1.0:1789120998.053742:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789120998.053745:0:6520:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789120998.054206:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:12719:x1876028947534848:12345-192.168.202.32@tcp:36:rm.0 Request processed in 5739us (5948us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789120998.054218:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 214 00010000:00010000:2.0:1789120998.098851:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789120998.142733:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120998.142927:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947535104 00000100:00100000:2.0:1789120998.142940:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947535104 00000100:00100000:2.0:1789120998.143022:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 215 00000100:00100000:2.0:1789120998.143033:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+39:12725:x1876028947535104:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789120998.143064:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120998.143091:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a000/0xb74d2367a8310229 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ecfd expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.143234:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a8310230 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.143254:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a8310230 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.143268:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a8310230 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.143281:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.143289:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.143316:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789120998.143769:0:9342:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789120998.143992:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831023e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144005:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831023e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144013:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831023e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144048:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a8310230 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144055:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a8310230 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144064:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a8310230 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144070:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3aa00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120998.144075:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a8310230 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144083:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a8310230 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144096:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:2.0:1789120998.144099:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120998.144115:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a8310230 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144123:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3aa00/0xb74d2367a8310230 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120998.144139:0:9342:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000167a670b reply state 000000006b2b24e7 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144154:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144162:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bff00) 00010000:00010000:2.0:1789120998.144164:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789120998.144167:0:9342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789120998.144205:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a000/0xb74d2367a8310229 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecfd expref: 42 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144220:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831023e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecfd expref: 41 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.144226:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468a3998200) 00010000:00010000:2.0:1789120998.144229:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120998.144232:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3a600, rc 0) 00000100:00100000:2.0:1789120998.144327:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+42:12725:x1876028947535104:12345-192.168.202.32@tcp:101:bash.0 Request processed in 1295us (1619us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789120998.144336:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 215 00000100:00100000:0.0:1789120998.151285:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120998.154073:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947535232 00000100:00100000:2.0:1789120998.154377:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947535232 00000100:00100000:2.0:1789120998.154635:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:2.0:1789120998.154649:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947535232:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789120998.154693:0:8435:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120998.154733:0:8435:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051bc7675/0xb74d2367a831024c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed04 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120998.154778:0:8435:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789120998.154806:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=448s v=(0 0) 00010000:00010000:2.0:1789120998.154811:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120998.154845:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051bc7675/0xb74d2367a831024c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed04 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.154881:0:8435:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000051bc7675/0xb74d2367a831024c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed04 expref: 6 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.154900:0:8435:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3ae00, rc 0) 00000100:00100000:2.0:1789120998.155452:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2412:x1876028947535232:12345-192.168.202.32@tcp:101:bash.0 Request processed in 803us (4181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120998.155462:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:3.0:1789120998.161543:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120998.161811:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947535360 00000100:00100000:0.0:1789120998.161883:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947535360 00000100:00100000:0.0:1789120998.161959:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:0.0:1789120998.161973:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:12725:x1876028947535360:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120998.161999:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120998.162024:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed0b expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.162065:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000051bc7675/0xb74d2367a831024c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed04 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.162098:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120998.162103:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120998.162109:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.162156:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000051bc7675/0xb74d2367a831024c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed04 expref: 7 pid: 8435 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.162172:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000051bc7675/0xb74d2367a831024c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed04 expref: 7 pid: 8435 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120998.162187:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876028970667776:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120998.162525:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783118f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120998.167274:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8434:1876028970667776:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120998.167323:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 7 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.167351:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22c00, rc 0) 00000100:00100000:0.0:1789120998.167431:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:12725:x1876028947535360:12345-192.168.202.32@tcp:101:bash.0 Request processed in 5461us (5910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120998.167443:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:3.0:1789120998.167664:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120998.168733:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947535488 00000100:00100000:0.0:1789120998.168744:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947535488 00010000:00010000:0.0:1789120998.168796:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000051bc7675/0xb74d2367a831024c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed04 expref: 7 pid: 8435 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120998.168910:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 109 00000100:00100000:0.0:1789120998.168922:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947535488:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789120998.168941:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120998.168969:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000051bc7675/0xb74d2367a831024c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed04 expref: 7 pid: 8435 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.168985:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000051bc7675/0xb74d2367a831024c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed04 expref: 7 pid: 8435 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.169014:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051bc7675/0xb74d2367a831024c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed04 expref: 7 pid: 8435 timeout: 548 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.169036:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120998.169041:0:6505:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789120998.169051:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.169062:0:6505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.169115:0:6505:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 6 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120998.169132:0:6505:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1876028970667904:192.168.202.32@tcp:105: 00000100:00100000:0.0:1789120998.169502:0:6505:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783118f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789120998.172430:0:6505:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6505:1876028970667904:192.168.202.32@tcp:105: 00010000:00010000:0.0:1789120998.172466:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789120998.172542:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2411:x1876028947535488:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 3621us (4878us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120998.172557:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 109 00000100:00100000:1.0:1789120998.180154:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120998.180380:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947535744 00000100:00100000:3.0:1789120998.180393:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947535744 00000100:00100000:3.0:1789120998.180475:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:3.0:1789120998.180487:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+42:12725:x1876028947535744:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:3.0:1789120998.181329:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:12725:x1876028947535744:12345-192.168.202.32@tcp:35:bash.0 Request processed in 839us (1184us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789120998.181341:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:2.0:1789120998.293076:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970668032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789120998.293187:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120998.294751:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970668032 00000100:00100000:0.0:1789120998.294779:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970668032 00000100:00100000:0.0:1789120998.295325:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789120998.295341:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970668032:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789120998.295382:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 33943232 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789120998.295497:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970668032:12345-0@lo:13:osp-pre-1-1.0 Request processed in 161us (2309us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120998.295506:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789120998.297985:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7492c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970668032:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789120998.351185:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120998.351260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120998.351383:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947535872 00000100:00100000:0.0:1789120998.351396:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947535872 00002000:00100000:0.0:1789120998.351470:0:8439:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff946783d1a580 x1876028947535872/t0(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:529/0 lens 504/0 e 0 to 0 dl 1789121009 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789120998.351483:0:8439:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff946783d1a580 with x1876028947535872 ext(0->8) 00002000:00010000:0.0:1789120998.351491:0:8439:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946783d1a580 00000100:00100000:0.0:1789120998.351528:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:0.0:1789120998.351539:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+6:2410:x1876028947535872:12345-192.168.202.32@tcp:4:bash.0 00000100:00100000:3.0:1789120998.352660:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947536000 00000100:00100000:3.0:1789120998.352670:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947536000 00000100:00100000:3.0:1789120998.352742:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:3.0:1789120998.352752:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2410:x1876028947536000:12345-192.168.202.32@tcp:16:kworker.0 00000100:00100000:3.0:1789120998.353113:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2410:x1876028947536000:12345-192.168.202.32@tcp:16:kworker.0 Request processed in 362us (1852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120998.353123:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:1.0:1789120998.364688:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2410:x1876028947535872:12345-192.168.202.32@tcp:4:bash.0 Request processed in 13132us (13500us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789120998.364707:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00002000:00100000:1.0:1789120998.364736:0:8439:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff946783d1a580 x1876028947535872/t4294967309(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:529/0 lens 504/448 e 0 to 0 dl 1789121009 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789120998.364747:0:8439:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff946783d1a580 with x1876028947535872 ext(0->8) 00002000:00010000:1.0:1789120998.364767:0:8439:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff946783d1a580 00000100:00100000:2.0:1789120998.467514:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120998.468238:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947536128 00000100:00100000:1.0:1789120998.468253:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947536128 00000100:00100000:1.0:1789120998.468338:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 216 00000100:00100000:1.0:1789120998.468350:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+43:12741:x1876028947536128:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789120998.468385:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120998.468413:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831025a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed12 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.468502:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310261 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.468516:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.468526:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120998.468575:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1789120998.468578:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789120998.468601:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310261 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.468632:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a831025a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed12 expref: 45 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.468653:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310261 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed12 expref: 44 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.468662:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:1.0:1789120998.468665:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789120998.468688:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3c00, rc 0) 00000100:00100000:1.0:1789120998.468783:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+44:12741:x1876028947536128:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 433us (1283us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120998.468791:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 216 00000100:00100000:0.0:1789120998.477639:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120998.477790:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947536384 00000100:00100000:1.0:1789120998.477802:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947536384 00000100:00100000:1.0:1789120998.477926:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 217 00000100:00100000:1.0:1789120998.477939:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+44:12741:x1876028947536384:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789120998.477969:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120998.477995:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310268 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed19 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.479773:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a831026f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.480190:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a831026f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.480207:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a831026f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120998.480406:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789120998.480613:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a8310268 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed19 expref: 47 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.480714:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a831026f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed19 expref: 46 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.480736:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468a3998200) 00010000:00010000:0.0:1789120998.480739:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120998.480745:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23600, rc 0) 00000100:00100000:0.0:1789120998.481454:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+46:12741:x1876028947536384:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 3512us (3828us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1789120998.481465:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 217 00000100:00100000:0.0:1789120998.488987:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120998.489743:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947536640 00000100:00100000:1.0:1789120998.489756:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947536640 00000100:00100000:1.0:1789120998.491472:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 218 00000100:00100000:1.0:1789120998.491496:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+46:12741:x1876028947536640:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789120998.491531:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120998.491560:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a831027d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed20 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.491702:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310284 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.491729:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310284 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.491744:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310284 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120998.491789:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789120998.493588:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a831027d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed20 expref: 49 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.493619:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310284 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed20 expref: 48 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.493700:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468a3998200) 00010000:00010000:1.0:1789120998.493704:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789120998.493709:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2600, rc 0) 00000100:00100000:1.0:1789120998.494127:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7483c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+48:12741:x1876028947536640:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 2639us (5224us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1789120998.494139:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 218 00000100:00100000:3.0:1789120998.494655:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120998.495016:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947536768 00000100:00100000:1.0:1789120998.495025:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947536768 00000100:00100000:1.0:1789120998.496175:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:1.0:1789120998.496192:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+48:2411:x1876028947536768:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789120998.496207:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789120998.496230:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a831026f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed19 expref: 48 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.496248:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468a3998200) 00010000:00010000:1.0:1789120998.496253:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789120998.496316:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835ea850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+47:2411:x1876028947536768:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 131us (1670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120998.496324:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:0.0:1789120998.499785:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120998.500389:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947536896 00000100:00100000:3.0:1789120998.500398:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947536896 00000100:00100000:3.0:1789120998.500452:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:3.0:1789120998.500460:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2411:x1876028947536896:12345-192.168.202.32@tcp:1:lfs.0 00010000:00010000:3.0:1789120998.500515:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.500533:0:8433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.500542:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120998.500546:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120998.500552:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.500583:0:8433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 8 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.500597:0:8433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 8 pid: 8434 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120998.500611:0:8433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876028970668160:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120998.500691:0:8433:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a240 going to sleep for 11 seconds 00000100:00100000:0.0:1789120998.506405:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120998.506751:0:8433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:8433:1876028970668160:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120998.506776:0:8433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120998.506926:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947537024 00000100:00100000:2.0:1789120998.506933:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947537024 00010000:00010000:2.0:1789120998.506980:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 9 pid: 8434 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120998.507017:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 110 00000100:00100000:2.0:1789120998.507026:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2412:x1876028947537024:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120998.507040:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789120998.507058:0:6504:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789120998.507060:0:6504:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1789120997 00002000:00010000:2.0:1789120998.507063:0:6504:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1789120997 00002000:00010000:2.0:1789120998.507065:0:6504:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1789120998.507070:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 9 pid: 8434 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.507082:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 9 pid: 8434 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.507103:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310253 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed0b expref: 9 pid: 8434 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.507117:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120998.507121:0:6504:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120998.507126:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.507135:0:6504:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.507176:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120998.507219:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947537024:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 194us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120998.507227:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 110 00010000:00010000:3.0:1789120998.507438:0:8433:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.507459:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.507478:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.507486:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.507494:0:8433:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.507502:0:8433:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789120998.507505:0:8433:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.507514:0:8433:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.507526:0:8433:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.507533:0:8433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb311c60/0xb74d2367a8310292 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120998.507586:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947536896:12345-192.168.202.32@tcp:1:lfs.0 Request processed in 7126us (7809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120998.507594:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 70 00000100:00100000:3.0:1789120998.515151:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120998.515241:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947537280 00000100:00100000:2.0:1789120998.515250:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947537280 00000100:00100000:2.0:1789120998.515314:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:2.0:1789120998.515324:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+47:12741:x1876028947537280:12345-192.168.202.32@tcp:35:lfs.0 00000004:00010000:2.0:1789120998.516752:0:6522:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310284 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed20 expref: 47 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120998.517691:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1789120998.517730:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1789120998.519013:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1789120998.519065:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.519085:0:6522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831023e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecfd expref: 51 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.519094:0:6522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.519127:0:6522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831023e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecfd expref: 51 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.519141:0:6522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831023e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecfd expref: 51 pid: 9342 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120998.519177:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d18780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1876028970668288:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120998.519255:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789120998.526461:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120998.526805:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947537408 00000100:00100000:3.0:1789120998.527522:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947537408 00010000:00010000:3.0:1789120998.527596:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831023e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecfd expref: 52 pid: 9342 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120998.527679:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 111 00000100:00100000:3.0:1789120998.527691:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+52:2412:x1876028947537408:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120998.527713:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120998.527730:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831023e lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecfd expref: 52 pid: 9342 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.527745:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831023e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecfd expref: 52 pid: 9342 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.527789:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468a3998200) 00010000:00010000:3.0:1789120998.527795:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.528352:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.528367:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.528415:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120998.528497:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+52:2412:x1876028947537408:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 806us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120998.528508:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 111 00010000:00010000:2.0:1789120998.529240:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831023e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecfd expref: 51 pid: 9342 timeout: 548 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120998.529264:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d18780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6522:1876028970668288:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120998.529297:0:6522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.529308:0:6522:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.529314:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120998.529462:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:2.0:1789120998.529600:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:2.0:1789120998.529785:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d18780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1876028970668416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789120998.531285:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120998.531340:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789120998.531714:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970668416 00000100:00100000:1.0:1789120998.531741:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970668416 00000100:00100000:1.0:1789120998.531876:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 211 00000100:00100000:1.0:1789120998.531889:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1876028970668416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789120998.532031:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6522:x1876028970668416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 144us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120998.532040:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 211 00000100:00100000:2.0:1789120998.532430:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d18780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1876028970668416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789120998.532630:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:2.0:1789120998.532742:0:6522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d18780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1876028970668544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789120998.533103:0:6522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789120998.533149:0:6522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789120998.533371:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970668544 00000100:00100000:3.0:1789120998.533379:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970668544 00000100:00100000:3.0:1789120998.533435:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1789120998.533446:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6522:x1876028970668544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789120998.533677:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6522:x1876028970668544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 177us (801us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789120998.533688:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789120998.534285:0:6522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d18780 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6522:1876028970668544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789120998.534392:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789120998.534451:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.534462:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.534471:0:6522:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.534477:0:6522:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3b600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120998.534482:0:6522:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.534491:0:6522:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.534511:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468a3998200) 00010000:00010000:2.0:1789120998.534514:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789120998.534520:0:6522:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.534527:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310299 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789120998.534742:0:6522:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789120998.535368:0:6522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789120998.535384:0:6522:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 448724562695ns, next at 449724559822ns, rc = 0 00000001:00080000:2.0:1789120998.535394:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:2.0:1789120998.535434:0:6522:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468a3998200) 00010000:00010000:2.0:1789120998.535439:0:6522:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789120998.535460:0:6522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a8310284 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed20 expref: 55 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120998.535613:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913ff450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:12741:x1876028947537280:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 20290us (20469us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789120998.535635:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 56 00000020:00080000:2.0:1789120998.535641:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789120998.539239:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120998.539373:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947537536 00000100:00100000:1.0:1789120998.539387:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947537536 00000100:00100000:1.0:1789120998.539474:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 219 00000100:00100000:1.0:1789120998.539486:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+54:12741:x1876028947537536:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789120998.539520:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120998.539553:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83102a0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed27 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.539646:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83102a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed27 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.539665:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83102a0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed27 expref: 55 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.539689:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:1.0:1789120998.539692:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789120998.539697:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3200, rc 0) 00000100:00100000:1.0:1789120998.539804:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+55:12741:x1876028947537536:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 319us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120998.539848:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 219 00000100:00100000:1.0:1789120998.555038:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120998.555179:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947537792 00000100:00100000:0.0:1789120998.555193:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947537792 00000100:00100000:0.0:1789120998.556474:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:0.0:1789120998.556495:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+55:12741:x1876028947537792:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789120998.558380:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+56:12741:x1876028947537792:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 1877us (3341us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1789120998.558398:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:1.0:1789120998.645119:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120998.647101:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947537920 00000100:00100000:0.0:1789120998.647121:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947537920 00000100:00100000:0.0:1789120998.647240:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 220 00000100:00100000:0.0:1789120998.647253:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+56:12751:x1876028947537920:12345-192.168.202.32@tcp:34:lfs.0 00010000:00010000:0.0:1789120998.647366:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a83102a7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.647390:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a83102a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.647405:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a83102a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.647419:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ae lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.647427:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.647435:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.647786:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102b5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.647798:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.647886:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789120998.648034:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648051:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a83102a7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648057:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a83102a7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648066:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a83102a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648072:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120998.648077:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a83102a7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648085:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a83102a7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648099:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:0.0:1789120998.648102:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120998.648108:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a83102a7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648114:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a83102a7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648128:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ae lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648141:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ae lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648147:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648152:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120998.648155:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ae lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648161:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ae lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648169:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bff00) 00010000:00010000:0.0:1789120998.648172:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120998.648175:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ae lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648182:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ae lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648194:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102b5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648201:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102b5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648207:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.648212:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120998.649107:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102b5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.649119:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102b5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.649133:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:0.0:1789120998.649136:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120998.649140:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102b5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.649147:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102b5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120998.654756:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+56:12751:x1876028947537920:12345-192.168.202.32@tcp:34:lfs.0 Request processed in 7485us (9633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120998.654778:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 220 00000100:00100000:3.0:1789120998.724190:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120998.724603:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947538176 00000100:00100000:1.0:1789120998.724617:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947538176 00000100:00100000:1.0:1789120998.724788:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 221 00000100:00100000:1.0:1789120998.724801:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+56:12754:x1876028947538176:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789120998.724874:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120998.724912:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83102bc lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed2e expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.725016:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83102c3 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.725031:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83102c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.725041:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83102c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.725049:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a83102ca lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.725055:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a83102ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.725073:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a83102ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.725215:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83102d1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.726842:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83102d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.726864:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83102d1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120998.726885:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789120998.727047:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83102c3 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727057:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83102c3 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727065:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83102c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727073:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120998.727079:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83102c3 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727088:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83102c3 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727104:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:1.0:1789120998.727107:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120998.727112:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83102c3 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727144:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2600/0xb74d2367a83102c3 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727164:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a83102ca lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727171:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a83102ca lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727178:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a83102ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727183:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120998.727186:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a83102ca lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727193:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a83102ca lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727202:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bff00) 00010000:00010000:1.0:1789120998.727205:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120998.727208:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a83102ca lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727213:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3600/0xb74d2367a83102ca lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727648:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a83102bc lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed2e expref: 59 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727680:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83102d1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed2e expref: 58 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.727688:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:1.0:1789120998.727691:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120998.727693:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2a00, rc 0) 00000100:00100000:1.0:1789120998.728216:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+58:12754:x1876028947538176:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 3024us (3746us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789120998.728244:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 221 00000100:00100000:3.0:1789120998.732135:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120998.733818:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947538304 00000100:00100000:1.0:1789120998.733848:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947538304 00000100:00100000:1.0:1789120998.733955:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 222 00000100:00100000:1.0:1789120998.733968:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+58:12754:x1876028947538304:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:1.0:1789120998.734070:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83102df lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.734094:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83102df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.734110:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83102df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.734156:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83102df lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.734163:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83102df lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.734193:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83102df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.734201:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120998.734205:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83102df lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.734214:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83102df lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.734236:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:1.0:1789120998.734240:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120998.734245:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83102df lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120998.734252:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3400/0xb74d2367a83102df lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120998.734352:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+58:12754:x1876028947538304:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 386us (2230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120998.734362:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 222 00000100:00100000:1.0:1789120998.738385:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120998.738485:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947538560 00000100:00100000:3.0:1789120998.738497:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947538560 00000100:00100000:3.0:1789120998.738554:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:3.0:1789120998.738562:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+58:12754:x1876028947538560:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:3.0:1789120998.739109:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+59:12754:x1876028947538560:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 545us (741us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789120998.739117:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:1.0:1789120998.837610:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120998.838789:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947538816 00000100:00100000:0.0:1789120998.838804:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947538816 00000100:00100000:0.0:1789120998.838939:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 223 00000100:00100000:0.0:1789120998.838952:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+59:12764:x1876028947538816:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120998.838986:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120998.838990:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789120998.839029:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310261 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed12 expref: 59 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.839052:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:0.0:1789120998.839058:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120998.839075:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102e6 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed35 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.839218:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.839272:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.839284:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120998.839299:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1789120998.839448:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102e6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed35 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.839464:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed35 expref: 60 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.839472:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:0.0:1789120998.839475:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120998.839478:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23a00, rc 0) 00000100:00100000:0.0:1789120998.839582:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:12764:x1876028947538816:12345-192.168.202.32@tcp:101:bash.0 Request processed in 632us (1989us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1789120998.839591:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 223 00000100:00100000:1.0:1789120998.856102:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120998.861572:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947538944 00000100:00100000:0.0:1789120998.861596:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947538944 00000100:00100000:1.0:1789120998.861664:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120998.861783:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947539072 00000100:00100000:3.0:1789120998.861788:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947539072 00000100:00100000:3.0:1789120998.861879:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:3.0:1789120998.861891:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+61:2411:x1876028947539072:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120998.861935:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120998.861972:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a83102ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed35 expref: 61 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.861998:0:6503:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:3.0:1789120998.862005:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120998.862081:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:2411:x1876028947539072:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 192us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120998.862090:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:0.0:1789120998.862107:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 224 00000100:00100000:0.0:1789120998.862116:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+59:12764:x1876028947538944:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120998.862148:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120998.862169:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102fb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed3c expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.862379:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8310302 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.862396:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8310302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.862409:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8310302 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.862886:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a83102fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed3c expref: 61 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.863359:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8310302 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed3c expref: 60 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.863370:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:0.0:1789120998.863373:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789120998.863377:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22200, rc 0) 00000100:00100000:0.0:1789120998.863450:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:12764:x1876028947538944:12345-192.168.202.32@tcp:101:bash.0 Request processed in 1334us (7362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120998.863460:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 224 00000100:00100000:1.0:1789120998.866595:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120998.867330:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947539328 00000100:00100000:2.0:1789120998.867344:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947539328 00000100:00100000:2.0:1789120998.867474:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 225 00000100:00100000:2.0:1789120998.867489:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+60:12764:x1876028947539328:12345-192.168.202.32@tcp:36:bash.0 00010000:00010000:2.0:1789120998.867568:0:9342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120998.867609:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2a00/0xb74d2367a83102d1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed2e expref: 60 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.867645:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:2.0:1789120998.867652:0:9342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120998.868073:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.868093:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.868104:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789120998.868158:0:9342:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:2.0:1789120998.868200:0:9342:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bf118a46 reply state 0000000077399ed5 transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.868240:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.868246:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:2.0:1789120998.868249:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789120998.868253:0:9342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120998.868374:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+62:12764:x1876028947539328:12345-192.168.202.32@tcp:36:bash.0 Request processed in 887us (1949us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789120998.868385:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 225 00000020:00080000:2.0:1789120998.868392:0:9342:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789120998.871540:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120998.872388:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947539456 00000100:00100000:0.0:1789120998.872402:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947539456 00000100:00100000:0.0:1789120998.872489:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 226 00000100:00100000:0.0:1789120998.872502:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+62:12764:x1876028947539456:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:0.0:1789120998.872536:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120998.872564:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310310 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed43 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.872730:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.872749:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.872763:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120998.872800:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789120998.872804:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789120998.872846:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.873161:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a8310310 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed43 expref: 64 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.873183:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed43 expref: 63 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.873195:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:0.0:1789120998.873198:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120998.873203:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23a00, rc 0) 00000100:00100000:0.0:1789120998.873293:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+63:12764:x1876028947539456:12345-192.168.202.32@tcp:101:bash.0 Request processed in 794us (1768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120998.873303:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 226 00000100:00100000:1.0:1789120998.883099:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120998.883214:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947539712 00000100:00100000:3.0:1789120998.883227:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947539712 00000100:00100000:3.0:1789120998.883336:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:3.0:1789120998.883348:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+63:12764:x1876028947539712:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:3.0:1789120998.883683:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+64:12764:x1876028947539712:12345-192.168.202.32@tcp:35:bash.0 Request processed in 336us (598us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1789120998.883693:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:1.0:1789120998.979007:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120998.979130:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947539840 00000100:00100000:0.0:1789120998.979145:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947539840 00000100:00100000:0.0:1789120998.979232:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 227 00000100:00100000:0.0:1789120998.979246:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+64:12770:x1876028947539840:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789120998.979284:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120998.979314:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a831031e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed4a expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.979409:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a8310325 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.979427:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a8310325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.979442:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a8310325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120998.979508:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:0.0:1789120998.979512:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789120998.979538:0:6518:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a8310325 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.979569:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23800/0xb74d2367a831031e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed4a expref: 66 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.979590:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a8310325 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed4a expref: 65 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.979600:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:0.0:1789120998.979603:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789120998.979608:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22e00, rc 0) 00000100:00100000:0.0:1789120998.982170:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+65:12770:x1876028947539840:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 2908us (3159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120998.982209:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 227 00000100:00100000:1.0:1789120998.988923:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120998.989133:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947539968 00000100:00100000:0.0:1789120998.989147:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947539968 00000100:00100000:0.0:1789120998.989230:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 228 00000100:00100000:0.0:1789120998.989243:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+65:12770:x1876028947539968:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789120998.989275:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120998.989305:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a831032c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed51 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989401:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310333 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989421:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310333 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989437:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310333 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989451:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831033a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989457:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831033a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989464:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831033a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989555:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a8310341 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989581:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a8310341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989589:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a8310341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789120998.989779:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789120998.989785:0:6520:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789120998.989810:0:6520:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a8310341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989955:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a8310341 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989968:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310333 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989975:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310333 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989982:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310333 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.989990:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120998.989994:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310333 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990003:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310333 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990018:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:0.0:1789120998.990021:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120998.990040:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310333 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990047:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a8310333 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990063:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831033a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990069:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831033a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990075:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831033a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990081:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120998.990084:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831033a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990090:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831033a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990098:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bff00) 00010000:00010000:0.0:1789120998.990101:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120998.990104:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831033a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990110:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831033a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990143:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a831032c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed51 expref: 67 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990170:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a8310341 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed51 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120998.990178:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:0.0:1789120998.990180:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789120998.990183:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22c00, rc 0) 00000100:00100000:0.0:1789120998.990280:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:12770:x1876028947539968:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1038us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120998.990289:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 228 00000100:00100000:1.0:1789120998.996159:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120998.996231:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120998.996444:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947540352 00000100:00100000:2.0:1789120998.996456:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947540352 00000100:00100000:2.0:1789120998.996542:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:2.0:1789120998.996554:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:2411:x1876028947540352:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120998.996575:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120998.996607:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22c00/0xb74d2367a8310341 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed51 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120998.996637:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:2.0:1789120998.996643:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120998.996729:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+65:2411:x1876028947540352:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 176us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120998.996738:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:3.0:1789120998.997423:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947540224 00000100:00100000:3.0:1789120998.997432:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947540224 00000100:00100000:3.0:1789120998.997486:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 229 00000100:00100000:3.0:1789120998.997494:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+65:12770:x1876028947540224:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789120998.997518:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120998.997542:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310348 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed58 expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.998178:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.998219:0:11088:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed43 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.998230:0:11088:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 4/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.998277:0:11088:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed43 expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120998.998294:0:11088:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed43 expref: 66 pid: 6520 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120998.998310:0:11088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970668672:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120998.998432:0:11088:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a540 going to sleep for 11 seconds 00000100:00100000:1.0:1789120999.003676:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.003787:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947540480 00000100:00100000:2.0:1789120999.003799:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947540480 00010000:00010000:2.0:1789120999.003897:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed43 expref: 67 pid: 6520 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.003972:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 112 00000100:00100000:2.0:1789120999.003985:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946889570780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:2412:x1876028947540480:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120999.004006:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120999.004015:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed43 expref: 67 pid: 6520 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.004030:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed43 expref: 67 pid: 6520 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.004062:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:2.0:1789120999.004068:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.004080:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.004089:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.004115:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120999.004186:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946889570780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:2412:x1876028947540480:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 203us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120999.004196:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 112 00000100:00080000:1.0:1789120999.005402:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789120999.005789:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310317 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed43 expref: 66 pid: 6520 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120999.005817:0:11088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:11088:1876028970668672:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120999.005897:0:11088:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.005910:0:11088:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.005915:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789120999.005942:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789120999.006143:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310348 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed58 expref: 67 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.006160:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed58 expref: 66 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.006169:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:3.0:1789120999.006172:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789120999.006176:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55600, rc 0) 00000100:00100000:3.0:1789120999.006244:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:12770:x1876028947540224:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 8751us (10099us total) trans 4294967504 rc 0/0 00000100:00100000:3.0:1789120999.006255:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 229 00000100:00100000:1.0:1789120999.011981:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.012179:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947540736 00000100:00100000:2.0:1789120999.012193:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947540736 00000100:00100000:2.0:1789120999.012291:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:2.0:1789120999.012305:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946889573840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:12770:x1876028947540736:12345-192.168.202.32@tcp:103:lfs.0 00010000:00010000:2.0:1789120999.012347:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120999.012380:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a83102a0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed27 expref: 66 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.012403:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:2.0:1789120999.012410:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120999.012487:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946889573840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+65:12770:x1876028947540736:12345-192.168.202.32@tcp:103:lfs.0 Request processed in 185us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120999.012495:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:2.0:1789120999.015264:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120999.015370:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947540864 00000100:00100000:0.0:1789120999.015382:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947540864 00000100:00100000:0.0:1789120999.015462:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 230 00000100:00100000:0.0:1789120999.015474:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+65:12770:x1876028947540864:12345-192.168.202.32@tcp:58:lfs.0 00010000:00010000:0.0:1789120999.015659:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.015682:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.015698:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789120999.016727:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1789120999.017171:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+65:12770:x1876028947540864:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 1691us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120999.017184:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 230 00000100:00100000:0.0:1789120999.019740:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120999.020056:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947540992 00000100:00100000:1.0:1789120999.020068:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947540992 00000100:00100000:1.0:1789120999.020190:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 231 00000100:00100000:1.0:1789120999.020203:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+65:12770:x1876028947540992:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789120999.020236:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120999.020268:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a8310364 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed5f expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.020345:0:6520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.020359:0:6520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a8310364 lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed5f expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.020385:0:6520:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.020402:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a8310364 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed5f expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.020443:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:1.0:1789120999.020446:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789120999.020451:0:6520:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a8310364 lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed5f expref: 66 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.020459:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217c000, rc 0) 00000100:00100000:1.0:1789120999.020538:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:12770:x1876028947540992:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 337us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120999.020546:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 231 00010000:00010000:1.0:1789120999.123269:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789120999.442149:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789120999.442162:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789120999.442245:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789120999.442256:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789120999.442457:0:14508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970668800:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789120999.442639:0:14508:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120999.460492:0:14508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970668800:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789120999.469995:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120999.470173:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947541120 00000100:00100000:1.0:1789120999.470185:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947541120 00000100:00100000:1.0:1789120999.470282:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 232 00000100:00100000:1.0:1789120999.470294:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:12771:x1876028947541120:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789120999.470342:0:11088:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789120999.470491:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:12771:x1876028947541120:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 198us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120999.470500:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 232 00000100:00100000:0.0:1789120999.480201:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120999.481069:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947541248 00000100:00100000:1.0:1789120999.481088:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947541248 00000100:00100000:1.0:1789120999.481187:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 233 00000100:00100000:1.0:1789120999.481199:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:12771:x1876028947541248:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789120999.481316:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a831036b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481362:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a831036b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481377:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a831036b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481540:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310372 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481564:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310372 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481577:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310372 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481611:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310379 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481619:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481627:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120999.481676:0:6518:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789120999.481682:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789120999.481696:0:6518:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481709:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a831036b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481746:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a831036b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481754:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a831036b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481760:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217cc00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.481769:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a831036b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481777:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a831036b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481788:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:1.0:1789120999.481791:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120999.481796:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a831036b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.481803:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a831036b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482115:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310372 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482123:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310372 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482128:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310372 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482133:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.482145:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310372 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482151:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310372 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482161:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9468852bfa00) 00010000:00010000:1.0:1789120999.482163:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120999.482166:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310372 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482172:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310372 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482191:0:6518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310379 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482198:0:6518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310379 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482222:0:6518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310379 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482227:0:6518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.482230:0:6518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310379 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482235:0:6518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310379 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482251:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:1.0:1789120999.482254:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120999.482264:0:6518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310379 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.482270:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310379 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120999.482593:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:12771:x1876028947541248:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 Request processed in 1390us (2403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120999.482604:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 233 00000100:00100000:0.0:1789120999.494133:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120999.494549:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947541504 00000100:00100000:1.0:1789120999.494559:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947541504 00000100:00100000:1.0:1789120999.494645:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 234 00000100:00100000:1.0:1789120999.494656:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+66:12771:x1876028947541504:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789120999.494677:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120999.494699:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310380 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed66 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.494859:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310387 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.494875:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.494886:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120999.494898:0:6520:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789120999.494980:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310387 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.494988:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310387 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.494993:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.495016:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.495021:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310387 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.495028:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310387 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.495054:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:1.0:1789120999.495057:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789120999.495063:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310387 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.495068:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310387 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.495123:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310380 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed66 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.495134:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:1.0:1789120999.495136:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789120999.495139:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a8310380 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed66 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.495149:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d200, rc 0) 00000100:00100000:1.0:1789120999.496524:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:12771:x1876028947541504:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 547us (1078us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1789120999.496544:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 234 00000100:00100000:3.0:1789120999.501417:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120999.504209:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947541632 00000100:00100000:0.0:1789120999.504305:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947541632 00000100:00100000:0.0:1789120999.504479:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 235 00000100:00100000:0.0:1789120999.504491:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:12771:x1876028947541632:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789120999.504541:0:9342:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789120999.504727:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:12771:x1876028947541632:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 238us (3326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120999.504736:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 235 00000100:00100000:0.0:1789120999.514160:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120999.514278:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947541888 00000100:00100000:3.0:1789120999.514292:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947541888 00000100:00100000:3.0:1789120999.514394:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 236 00000100:00100000:3.0:1789120999.514406:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:12771:x1876028947541888:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120999.514433:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120999.514437:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789120999.514476:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22e00/0xb74d2367a8310325 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed4a expref: 67 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.514500:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789120999.514507:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789120999.514524:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310395 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed6d expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789120999.515681:0:6518:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789120999.517218:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a831039c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.517313:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a831039c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.517329:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a831039c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.517424:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54e00/0xb74d2367a8310395 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed6d expref: 69 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.517463:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a831039c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed6d expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.517474:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468a3b96b00) 00010000:00010000:2.0:1789120999.517477:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789120999.517481:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3b400, rc 0) 00000100:00100000:2.0:1789120999.517670:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+68:12771:x1876028947541888:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 3264us (3521us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789120999.517681:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 236 00000100:00100000:1.0:1789120999.524271:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120999.524424:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947542144 00000100:00100000:0.0:1789120999.524437:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947542144 00000100:00100000:0.0:1789120999.524550:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 237 00000100:00100000:0.0:1789120999.524562:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+68:12771:x1876028947542144:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789120999.524657:0:6520:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789120999.524699:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b400/0xb74d2367a831039c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed6d expref: 68 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.524732:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468a3b96b00) 00010000:00010000:0.0:1789120999.524745:0:6520:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789120999.524784:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83103aa lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.524800:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83103aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.524812:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83103aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.524887:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a83103b1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0xff04adc4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.524905:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a83103b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xff04adc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.524912:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a83103b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xff04adc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.524968:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83103aa lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.524976:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83103aa lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.524983:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83103aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.524989:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120999.524993:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83103aa lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.525001:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83103aa lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.525009:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:0.0:1789120999.525012:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120999.525016:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83103aa lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.525023:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23400/0xb74d2367a83103aa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.525038:0:6520:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a83103b1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0xff04adc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.525044:0:6520:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a83103b1 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xff04adc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.525049:0:6520:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a83103b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xff04adc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.525054:0:6520:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789120999.525057:0:6520:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a83103b1 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xff04adc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.525063:0:6520:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a83103b1 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0xff04adc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.525070:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0xff04adc4 (ffff9468c1bd2300) 00010000:00010000:0.0:1789120999.525072:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789120999.525075:0:6520:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a83103b1 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xff04adc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.525080:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a83103b1 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0xff04adc4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120999.525180:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eade00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:12771:x1876028947542144:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 620us (924us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789120999.525188:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 237 00000100:00100000:2.0:1789120999.528806:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120999.529393:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947542272 00000100:00100000:0.0:1789120999.529407:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947542272 00000100:00100000:0.0:1789120999.529538:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 238 00000100:00100000:0.0:1789120999.529572:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+67:12771:x1876028947542272:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789120999.529616:0:6520:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789120999.529659:0:6520:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83103b8 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed74 expref: -99 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.529729:0:6520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83103bf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.529746:0:6520:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83103bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.529759:0:6520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83103bf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.530115:0:6520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23600/0xb74d2367a83103b8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed74 expref: 69 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.530140:0:6520:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83103bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed74 expref: 68 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.530151:0:6520:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:0.0:1789120999.530154:0:6520:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789120999.530158:0:6520:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23e00, rc 0) 00000100:00100000:0.0:1789120999.530249:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+68:12771:x1876028947542272:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 680us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120999.530258:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 238 00000100:00100000:2.0:1789120999.536452:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120999.537180:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947542528 00000100:00100000:0.0:1789120999.537195:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947542528 00000100:00100000:0.0:1789120999.537315:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 239 00000100:00100000:0.0:1789120999.537345:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+68:12771:x1876028947542528:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789120999.537484:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.537507:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.537521:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789120999.538132:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1789120999.538148:0:6518:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 449727326600ns, next at 450727322530ns, rc = 0 00000004:00010000:0.0:1789120999.538232:0:6518:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000ed7203fa reply state 0000000015defd21 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.538250:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.538260:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:0.0:1789120999.538263:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789120999.538280:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789120999.538492:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+70:12771:x1876028947542528:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 1146us (2051us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1789120999.538503:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 239 00000100:00100000:1.0:1789120999.548963:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120999.549168:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947542656 00000100:00100000:3.0:1789120999.549182:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947542656 00000100:00100000:3.0:1789120999.549270:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 240 00000100:00100000:3.0:1789120999.549283:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+70:12771:x1876028947542656:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120999.549319:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120999.549349:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83103cd lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed7b expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.549430:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83103cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed7b expref: 71 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.549447:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83103cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed7b expref: 71 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.549468:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:3.0:1789120999.549472:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789120999.549476:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55800, rc 0) 00000100:00100000:3.0:1789120999.549549:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+71:12771:x1876028947542656:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 269us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120999.549557:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 240 00000100:00100000:2.0:1789120999.554917:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120999.555136:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947542784 00000100:00100000:3.0:1789120999.555151:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947542784 00000100:00100000:3.0:1789120999.555256:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00100000:3.0:1789120999.555271:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2410:x1876028947542784:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789120999.555564:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:2410:x1876028947542784:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 296us (659us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1789120999.555574:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 71 00000100:00080000:1.0:1789120999.555729:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120999.565581:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120999.565767:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947543040 00000100:00100000:0.0:1789120999.565782:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947543040 00000100:00100000:3.0:1789120999.566178:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:3.0:1789120999.566195:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+71:12771:x1876028947543040:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789120999.566516:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+72:12771:x1876028947543040:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 325us (950us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1789120999.566526:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:0.0:1789120999.577777:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.578015:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947543296 00000100:00100000:2.0:1789120999.578028:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947543296 00000100:00100000:2.0:1789120999.578105:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 241 00000100:00100000:2.0:1789120999.578117:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+72:12771:x1876028947543296:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789120999.578287:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+72:12771:x1876028947543296:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 172us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120999.578296:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 241 00000100:00100000:0.0:1789120999.581524:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.581906:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947543424 00000100:00100000:2.0:1789120999.581920:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947543424 00000100:00100000:2.0:1789120999.582006:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 242 00000100:00100000:2.0:1789120999.582018:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+72:12771:x1876028947543424:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120999.582073:0:6518:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120999.582106:0:6518:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a83103d4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed82 expref: -99 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.582202:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83103db lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.582221:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83103db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.582751:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83103db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789120999.582814:0:6518:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789120999.583184:0:6518:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83103db lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.587744:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3bc00/0xb74d2367a83103d4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed82 expref: 74 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.587787:0:6518:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83103db lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed82 expref: 73 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.587800:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:2.0:1789120999.587803:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789120999.587808:0:6518:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3be00, rc 0) 00000100:00100000:2.0:1789120999.588103:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+73:12771:x1876028947543424:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 6083us (6591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120999.588114:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 242 00000100:00100000:0.0:1789120999.596144:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120999.596397:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947543552 00000100:00100000:3.0:1789120999.596410:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947543552 00000100:00100000:3.0:1789120999.596497:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:2.0:1789120999.596543:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+10:2412:x1876028947543552:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789120999.596580:0:8434:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789120999.596618:0:8434:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000984dac5a/0xb74d2367a83103e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed89 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789120999.596651:0:8434:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3d1e7, blocks: 0x0 00010000:00010000:2.0:1789120999.596679:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1789120999.596684:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120999.596706:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000984dac5a/0xb74d2367a83103e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed89 expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.596738:0:8434:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000984dac5a/0xb74d2367a83103e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed89 expref: 11 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.596756:0:8434:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3bc00, rc 0) 00000100:00100000:2.0:1789120999.596868:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:2412:x1876028947543552:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 361us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120999.596877:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 72 00000100:00100000:1.0:1789120999.622439:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120999.622762:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947543808 00000100:00100000:0.0:1789120999.622793:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947543808 00000100:00100000:0.0:1789120999.622927:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 243 00000100:00100000:0.0:1789120999.622938:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+73:12771:x1876028947543808:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789120999.623085:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+73:12771:x1876028947543808:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 149us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120999.623094:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 243 00000100:00100000:0.0:1789120999.628977:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120999.630968:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947543936 00000100:00100000:3.0:1789120999.630989:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947543936 00000100:00100000:3.0:1789120999.631088:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 73 00000100:00100000:3.0:1789120999.631100:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:12771:x1876028947543936:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789120999.631125:0:9116:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789120999.631151:0:9116:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed90 expref: -99 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.631191:0:9116:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000984dac5a/0xb74d2367a83103e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed89 expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.631202:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120999.631206:0:9116:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120999.631212:0:9116:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 12 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.631277:0:9116:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000984dac5a/0xb74d2367a83103e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed89 expref: 12 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.631319:0:9116:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000984dac5a/0xb74d2367a83103e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed89 expref: 12 pid: 8434 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120999.631336:0:9116:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9116:1876028970668928:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789120999.631486:0:9116:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a240 going to sleep for 11 seconds 00000100:00100000:3.0:1789120999.638791:0:9116:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1e940 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9116:1876028970668928:192.168.202.32@tcp:104: 00010000:00010000:3.0:1789120999.638885:0:9116:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 12 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.638921:0:9116:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54800, rc 0) 00000100:00100000:3.0:1789120999.639005:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:12771:x1876028947543936:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 7904us (10042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120999.639018:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 73 00000100:00100000:1.0:1789120999.643328:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120999.643788:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947544064 00000100:00100000:3.0:1789120999.643801:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947544064 00010000:00010000:3.0:1789120999.643904:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000984dac5a/0xb74d2367a83103e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed89 expref: 12 pid: 8434 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120999.643956:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 113 00000100:00100000:3.0:1789120999.643969:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+12:2412:x1876028947544064:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120999.643991:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120999.644020:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000984dac5a/0xb74d2367a83103e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed89 expref: 12 pid: 8434 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.644060:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000984dac5a/0xb74d2367a83103e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed89 expref: 12 pid: 8434 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.644092:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000984dac5a/0xb74d2367a83103e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed89 expref: 12 pid: 8434 timeout: 549 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.644113:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120999.644118:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120999.644128:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 11 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.644140:0:9525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 11 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.644188:0:9525:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 11 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120999.644205:0:9525:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1e940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9525:1876028970669056:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789120999.644579:0:9525:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a240 going to sleep for 11 seconds 00000100:00100000:2.0:1789120999.649053:0:9525:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1e940 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:9525:1876028970669056:192.168.202.32@tcp:105: 00010000:00010000:2.0:1789120999.649089:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120999.649159:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:2412:x1876028947544064:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 5191us (5845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120999.649172:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 113 00000100:00100000:1.0:1789120999.650956:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.651900:0:8440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947544192 00000100:00100000:2.0:1789120999.651935:0:8440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947544192 00002000:00100000:2.0:1789120999.652016:0:8440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9468a2eac3c0 x1876028947544192/t0(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:530/0 lens 504/0 e 0 to 0 dl 1789121010 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789120999.652030:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468a2eac3c0 with x1876028947544192 ext(0->12) 00002000:00010000:2.0:1789120999.652038:0:8440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468a2eac3c0 00000100:00100000:2.0:1789120999.652083:0:8440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:2.0:1789120999.652095:0:8440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+11:2411:x1876028947544192:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789120999.656196:0:8440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:2411:x1876028947544192:12345-192.168.202.32@tcp:4:lhsmtool_posix.0 Request processed in 4085us (5234us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789120999.656215:0:8440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00002000:00100000:2.0:1789120999.656244:0:8440:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x6:0x0] (0->12) req@ffff9468a2eac3c0 x1876028947544192/t4294967321(0) o4->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:530/0 lens 504/448 e 0 to 0 dl 1789121010 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789120999.656256:0:8440:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468a2eac3c0 with x1876028947544192 ext(0->12) 00002000:00010000:2.0:1789120999.656264:0:8440:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468a2eac3c0 00000100:00100000:1.0:1789120999.664698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120999.664811:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947544320 00000100:00100000:3.0:1789120999.664870:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947544320 00000100:00100000:3.0:1789120999.664955:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 244 00000100:00100000:3.0:1789120999.664967:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+73:12771:x1876028947544320:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789120999.667626:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:0.0:1789120999.667653:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1789120999.667703:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789120999.667742:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9467831f7780 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789120999.667749:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94688a487500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9467831f73c0 00000020:00080000:0.0:1789120999.667753:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff94688a487300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff946783d69c00 00000004:00080000:0.0:1789120999.667796:0:6497:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1789120999.667876:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff946783237180 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789120999.667880:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9467810ff500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946783237c00 00000020:00080000:0.0:1789120999.667883:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9467810ff300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9468b9b02600 00000100:00100000:3.0:1789120999.668285:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789120999.668314:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970669440:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789120999.668428:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789120999.668493:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970669440 00000100:00100000:3.0:1789120999.668501:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970669440 00000100:00100000:3.0:1789120999.668570:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789120999.668581:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970669440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789120999.668615:0:8433:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00002000:00010000:3.0:1789120999.668661:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6aa3d1e5, atime: 0x0, ctime: 0x6aa3d1e5, blocks: 0x8 00010000:00010000:3.0:1789120999.668671:0:8433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b2516bd/0xb74d2367a83103f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.668692:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1789120999.668698:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789120999.668706:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b2516bd/0xb74d2367a83103f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.668738:0:8433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b2516bd/0xb74d2367a83103f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.668750:0:8433:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b2516bd/0xb74d2367a83103f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.668759:0:8433:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b2516bd/0xb74d2367a83103f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.668782:0:8433:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789120999.669011:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3645:x1876028970669440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 430us (582us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789120999.669033:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00010000:3.0:1789120999.669065:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120999.669073:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b2516bd/0xb74d2367a83103f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.669082:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789120999.669087:0:6507:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b2516bd/0xb74d2367a83103f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.669098:0:6507:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b2516bd/0xb74d2367a83103f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.669119:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b2516bd/0xb74d2367a83103f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.669128:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b2516bd/0xb74d2367a83103f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.669149:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120999.669151:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120999.669153:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789120999.669194:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946783d1e580/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789120999.669201:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970669440:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789120999.669344:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eae940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12771:x1876028947544320:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 Request processed in 4377us (4660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120999.669353:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 244 00000100:00100000:0.0:1789120999.669869:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970669184:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789120999.669923:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120999.670012:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789120999.670020:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970669312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789120999.670046:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789120999.670179:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1789120999.670241:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1789120999.671216:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673377:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673389:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673397:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3b200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.673403:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673415:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673439:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9468c1bd2100) 00010000:00010000:1.0:1789120999.673443:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120999.673450:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673456:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b200/0xb74d2367a83100ee lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673528:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673568:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673574:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673580:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.673584:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673590:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673600:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9468886f6700) 00010000:00010000:1.0:1789120999.673603:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120999.673606:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673612:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54a00/0xb74d2367a8310196 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673647:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673653:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673659:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673665:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.673675:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673682:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673691:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bff00) 00010000:00010000:1.0:1789120999.673694:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120999.673697:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673703:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3a00/0xb74d2367a8310214 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6520 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673727:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673733:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673739:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673744:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3a400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.673747:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673754:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673762:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bff00) 00010000:00010000:1.0:1789120999.673765:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120999.673774:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673780:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a400/0xb74d2367a8310237 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673799:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673805:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673811:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673817:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3b600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.673848:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.673855:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.675464:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:1.0:1789120999.675468:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120999.675475:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.675482:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b600/0xb74d2367a8310309 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.675507:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.675514:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.675539:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.675544:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.675548:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.675556:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.675564:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:1.0:1789120999.675567:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789120999.675570:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.675576:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22600/0xb74d2367a83103c6 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789120999.675604:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789120999.682058:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.685250:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970669184 00000100:00100000:2.0:1789120999.685273:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970669184 00000100:00100000:2.0:1789120999.685402:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970669312 00000100:00100000:2.0:1789120999.685406:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970669312 00000100:00100000:2.0:1789120999.685432:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789120999.685444:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3646:x1876028970669184:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789120999.685485:0:8435:0:(ofd_dev.c:1876:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00010000:00010000:2.0:1789120999.685518:0:8435:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.685544:0:8435:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83101a4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece8 expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.685577:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789120999.685582:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120999.685588:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.685644:0:8435:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83101a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece8 expref: 12 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.685660:0:8435:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83101a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece8 expref: 12 pid: 8434 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.685678:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8435:1876028970669568:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120999.685815:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7c00 going to sleep for 11 seconds 00000100:00080000:0.0:1789120999.686107:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789120999.686181:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789120999.686193:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3646:x1876028970669312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789120999.686358:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789120999.686363:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1789120999 00002000:00010000:2.0:1789120999.686366:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789120999.686369:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789120999 -> 1789120999 00002000:00010000:2.0:1789120999.686372:0:8434:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1789120999.686520:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3646:x1876028970669312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 330us (16473us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789120999.686530:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789120999.690110:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947544448 00000100:00100000:2.0:1789120999.690156:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947544448 00000100:00100000:2.0:1789120999.690246:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:2.0:1789120999.690258:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+13:2412:x1876028947544448:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1789120999.690425:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9468914dd2c0/2, rc 0, transno 4294967322 00000100:00100000:0.0:1789120999.690436:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dd2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970669312:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1789120999.692490:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8435:1876028970669568:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120999.692529:0:8435:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120999.692728:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000001:00080000:2.0:1789120999.692967:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1789120999.692978:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000100:00100000:1.0:1789120999.693255:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2ead2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947544448:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 Request processed in 2995us (11209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120999.693268:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 77 00000100:00100000:3.0:1789120999.693737:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947544576 00000100:00100000:3.0:1789120999.693746:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947544576 00010000:00010000:3.0:1789120999.693794:0:6503:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83101a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece8 expref: 8 pid: 8434 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120999.693875:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:3.0:1789120999.693885:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2411:x1876028947544576:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120999.693902:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120999.693909:0:6503:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83101a4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece8 expref: 8 pid: 8434 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.693923:0:6503:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83101a4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece8 expref: 8 pid: 8434 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.693954:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af4e6f3f/0xb74d2367a83101a4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ece8 expref: 8 pid: 8434 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.693975:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120999.693981:0:6503:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789120999.693988:0:6503:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.693999:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.694066:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120999.694101:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eada40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947544576:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 216us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120999.694109:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 114 00010000:00010000:0.0:1789120999.694585:0:8435:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.694597:0:8435:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.694609:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.694625:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.694647:0:8435:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789120999.695112:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876028970669184:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9668us (25186us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1789120999.695123:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:3.0:1789120999.695752:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789120999.695762:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.695775:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3a800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789120999.695780:0:6506:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.695792:0:6506:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.695816:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.696209:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1789120999.696218:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1789120999.696258:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9468914dd2c0, transno 4294967322 00000100:00100000:2.0:1789120999.696287:0:3646:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9468914df0c0 x1876028970669184/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789121015 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1789120999.696301:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9468914df0c0/2, rc 0, transno 4294967323 00000100:00100000:2.0:1789120999.696307:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970669184:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789120999.697127:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7c00aa9/0xb74d2367a83103f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8435 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.697162:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120999.697165:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789120999.697167:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789120999.700453:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.701068:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947544832 00000100:00100000:2.0:1789120999.701083:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947544832 00000100:00100000:2.0:1789120999.701207:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 245 00000100:00100000:2.0:1789120999.701220:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:12771:x1876028947544832:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789120999.701311:0:6518:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120999.701349:0:6518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a83103db lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed82 expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.701374:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:2.0:1789120999.701381:0:6518:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789120999.701448:0:6518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.701468:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.701481:0:6518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789120999.701660:0:6518:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000090dfcbd9 reply state 000000006699e85b transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.701677:0:6518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.701683:0:6518:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:2.0:1789120999.701686:0:6518:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789120999.701689:0:6518:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789120999.701884:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eaed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:12771:x1876028947544832:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 666us (1445us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1789120999.701902:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 245 00000100:00100000:1.0:1789120999.708173:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120999.713505:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947544960 00000100:00100000:3.0:1789120999.713529:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947544960 00000100:00100000:3.0:1789120999.713642:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 78 00000100:00100000:3.0:1789120999.713654:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2411:x1876028947544960:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789120999.714056:0:9116:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789120999.714061:0:9116:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb mtime from disk: 1789120999 -> 1789120998 00002000:00010000:3.0:1789120999.714063:0:9116:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb atime from disk: 0 -> 1789120998 00002000:00010000:3.0:1789120999.714065:0:9116:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb ctime from disk: 1789120999 -> 1789120998 00002000:00010000:3.0:1789120999.714068:0:9116:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1789120999.714208:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eae580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2411:x1876028947544960:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 555us (6050us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789120999.714218:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 78 00000100:00100000:1.0:1789120999.724534:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.727057:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947545216 00000100:00100000:2.0:1789120999.727079:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947545216 00000100:00100000:2.0:1789120999.729005:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 246 00000100:00100000:2.0:1789120999.729036:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:12771:x1876028947545216:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789120999.729143:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.729165:0:9342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83103bf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed74 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.729202:0:9342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.729269:0:9342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83103bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed74 expref: 22 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.729287:0:9342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83103bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed74 expref: 22 pid: 6520 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.729306:0:9342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970669696:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120999.729452:0:9342:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468812ed9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789120999.740350:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.740566:0:9342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970669696:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120999.740606:0:9342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120999.740854:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947545344 00000100:00100000:3.0:1789120999.740863:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947545344 00010000:00010000:3.0:1789120999.740928:0:10341:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83103bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed74 expref: 23 pid: 6520 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120999.740977:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:3.0:1789120999.740988:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+23:2411:x1876028947545344:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789120999.741008:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789120999.741016:0:10341:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83103bf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed74 expref: 23 pid: 6520 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.741031:0:10341:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83103bf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed74 expref: 23 pid: 6520 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.741060:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23e00/0xb74d2367a83103bf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed74 expref: 23 pid: 6520 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.741100:0:10341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:3.0:1789120999.741106:0:10341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.741118:0:10341:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.741127:0:10341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.741160:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789120999.741246:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706d00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:2411:x1876028947545344:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 259us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789120999.741254:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 115 00010000:00010000:1.0:1789120999.741664:0:9342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.741682:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.741746:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.741755:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.741762:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.741769:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3be00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.741774:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.741783:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.741794:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:1.0:1789120999.741797:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789120999.741801:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.741808:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3be00/0xb74d2367a8310405 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120999.741920:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:12771:x1876028947545216:12345-192.168.202.32@tcp:55:lhsmtool_posix.0 Request processed in 12900us (17401us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789120999.741931:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 246 00000100:00100000:0.0:1789120999.755560:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.755701:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947545472 00000100:00100000:2.0:1789120999.755726:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947545472 00000100:00100000:2.0:1789120999.755807:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 79 00000100:00100000:2.0:1789120999.755850:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947545472:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789120999.755930:0:8434:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.755959:0:8434:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 8 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.755970:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789120999.755996:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120999.756002:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 4/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.756055:0:8434:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 8 pid: 9116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.756073:0:8434:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 8 pid: 9116 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.756093:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1876028970669824:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120999.756218:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468812ed9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789120999.760200:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8434:1876028970669824:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120999.760254:0:8434:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120999.763771:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.773561:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947545600 00000100:00100000:2.0:1789120999.773584:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947545600 00010000:00010000:2.0:1789120999.773660:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 9 pid: 9116 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.773734:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:2.0:1789120999.773746:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+9:2412:x1876028947545600:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120999.773768:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120999.773798:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 9 pid: 9116 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.774109:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 9 pid: 9116 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.774141:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db1dd193/0xb74d2367a83103e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed90 expref: 9 pid: 9116 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.774161:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120999.774166:0:9525:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789120999.774173:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.774184:0:9525:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.774240:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789120999.774395:0:8434:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.774406:0:8434:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.774433:0:8434:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.774443:0:8434:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.774452:0:8434:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.774460:0:8434:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3ac00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789120999.774465:0:8434:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.774476:0:8434:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.774490:0:8434:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.774498:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eba9eb0/0xb74d2367a831040c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8434 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.774596:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947545600:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 849us (10839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120999.774607:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:1.0:1789120999.777248:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9e0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947545472:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 Request processed in 21394us (21670us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120999.777270:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 79 00000100:00100000:3.0:1789120999.785466:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120999.798030:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947545856 00000100:00100000:0.0:1789120999.798053:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947545856 00000100:00100000:0.0:1789120999.798169:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 247 00000100:00100000:0.0:1789120999.798184:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:12771:x1876028947545856:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789120999.798318:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.798342:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8310302 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed3c expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.798379:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.798429:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8310302 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed3c expref: 21 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.798445:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8310302 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed3c expref: 21 pid: 6518 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789120999.798463:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970669952:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789120999.798594:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789120999.806521:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120999.806688:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970669952:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789120999.806738:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.806957:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947545984 00000100:00100000:2.0:1789120999.806968:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947545984 00010000:00010000:2.0:1789120999.807023:0:6504:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8310302 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed3c expref: 22 pid: 6518 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.807075:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00100000:2.0:1789120999.807086:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:2412:x1876028947545984:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120999.807131:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120999.807140:0:6504:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8310302 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed3c expref: 22 pid: 6518 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.807155:0:6504:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8310302 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed3c expref: 22 pid: 6518 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.807189:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22200/0xb74d2367a8310302 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed3c expref: 22 pid: 6518 timeout: 549 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.807210:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:2.0:1789120999.807217:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a8310364 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed5f expref: 21 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.807229:0:6504:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.807239:0:6504:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.807247:0:6504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.807378:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120999.807454:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:2412:x1876028947545984:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 368us (948us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120999.807463:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 117 00010000:00010000:0.0:1789120999.809118:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.809139:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.816082:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.816144:0:6519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83103cd lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed7b expref: 21 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.816156:0:6519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.816218:0:6519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83103cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed7b expref: 21 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.816463:0:6519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83103cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed7b expref: 21 pid: 11088 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.816483:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970670080:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789120999.816985:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688357b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789120999.826502:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970670080:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120999.826545:0:6519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789120999.830107:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.830298:0:6505:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947546112 00000100:00100000:2.0:1789120999.830310:0:6505:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947546112 00010000:00010000:2.0:1789120999.830368:0:6505:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83103cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed7b expref: 22 pid: 11088 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.830419:0:6505:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 118 00000100:00100000:2.0:1789120999.830432:0:6505:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:2411:x1876028947546112:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120999.830452:0:6505:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120999.830478:0:6505:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83103cd lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed7b expref: 22 pid: 11088 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.830493:0:6505:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83103cd lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed7b expref: 22 pid: 11088 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.830527:0:6505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55800/0xb74d2367a83103cd lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed7b expref: 22 pid: 11088 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.830548:0:6505:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:2.0:1789120999.830554:0:6505:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.830565:0:6505:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.830573:0:6505:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.830619:0:6505:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120999.830695:0:6505:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:2411:x1876028947546112:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 265us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120999.830704:0:6505:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 118 00010000:00010000:0.0:1789120999.831067:0:6519:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.831077:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789120999.831226:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1789120999.831394:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:0.0:1789120999.831438:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1789120999.831542:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6519:1876028970670208:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789120999.831612:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120999.831661:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783118600 going to sleep for 11 seconds 00000100:00100000:1.0:1789120999.831746:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970670208 00000100:00100000:1.0:1789120999.831753:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970670208 00000100:00100000:1.0:1789120999.831803:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:1.0:1789120999.831813:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1876028970670208:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789120999.831975:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839efc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6519:x1876028970670208:12345-0@lo:1000:mdt00_001.0 Request processed in 164us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120999.831983:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:0.0:1789120999.832434:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6519:1876028970670208:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789120999.832607:0:6519:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:0.0:1789120999.832674:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6519:1876028970670336:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789120999.832732:0:6519:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789120999.832772:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783118e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789120999.832860:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970670336 00000100:00100000:1.0:1789120999.832867:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970670336 00000100:00100000:1.0:1789120999.832914:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:1.0:1789120999.832924:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6519:x1876028970670336:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789120999.833061:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6519:x1876028970670336:12345-0@lo:1000:mdt00_001.0 Request processed in 138us (328us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1789120999.833069:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1789120999.833264:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:6519:1876028970670336:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1789120999.833312:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833323:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833351:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833359:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3a600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120999.833363:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833373:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833394:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:2.0:1789120999.833398:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120999.833404:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833410:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a831041a lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833442:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833449:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833455:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833460:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120999.833462:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833478:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833487:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:2.0:1789120999.833490:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789120999.833498:0:6519:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a8310364 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed5f expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833511:0:6519:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a8310364 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed5f expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833522:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a8310364 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed5f expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.833558:0:6519:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a8310364 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed5f expref: 24 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.833572:0:6519:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970670464:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789120999.833665:0:6519:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688357b000 going to sleep for 11 seconds 00000100:00100000:3.0:1789120999.841124:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.841284:0:6519:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6519:1876028970670464:192.168.202.32@tcp:105: 00010000:00010000:2.0:1789120999.841323:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841337:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831035d lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841383:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a8310421 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841422:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a8310421 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841436:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a8310421 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841452:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a8310421 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841459:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a8310421 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841467:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a8310421 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841473:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3a600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120999.841478:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a8310421 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841486:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a8310421 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841500:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:2.0:1789120999.841502:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789120999.841506:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a8310421 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841513:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3a600/0xb74d2367a8310421 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841522:0:6519:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841534:0:6519:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841540:0:6519:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841545:0:6519:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789120999.841548:0:6519:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841553:0:6519:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841560:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:2.0:1789120999.841563:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789120999.841565:0:6519:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.841570:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310413 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.841779:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:12771:x1876028947545856:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 43596us (56326us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1789120999.841792:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 247 00000020:00080000:2.0:1789120999.841800:0:6519:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789120999.842063:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947546240 00000100:00100000:0.0:1789120999.842071:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947546240 00000100:00100000:0.0:1789120999.842121:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:0.0:1789120999.842131:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:12770:x1876028947546240:12345-192.168.202.32@tcp:49:lfs.0 00000100:00100000:0.0:1789120999.842251:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:12770:x1876028947546240:12345-192.168.202.32@tcp:49:lfs.0 Request processed in 122us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789120999.842258:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 61 00000040:00080000:3.0:1789120999.842609:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789120999.842614:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789120999.845296:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789120999.845328:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789120999.849532:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789120999.849590:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.849741:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947546752 00000100:00100000:2.0:1789120999.849754:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947546752 00000100:00100000:2.0:1789120999.849869:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 248 00000100:00100000:2.0:1789120999.849882:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:12770:x1876028947546752:12345-192.168.202.32@tcp:58:lfs.0 00000040:00080000:2.0:1789120999.850151:0:6518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789120999.850270:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:12770:x1876028947546752:12345-192.168.202.32@tcp:58:lfs.0 Request processed in 390us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120999.850279:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 248 00000100:00100000:3.0:1789120999.852612:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947546496 00000100:00100000:3.0:1789120999.852630:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947546496 00000100:00100000:3.0:1789120999.852720:0:6522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:3.0:1789120999.852731:0:6522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+24:12771:x1876028947546496:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789120999.853133:0:6522:0:(mdd_object.c:4024:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789120999.853192:0:6522:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1789120999.853241:0:6522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310428 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.853260:0:6522:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.853272:0:6522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310428 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.853282:0:6522:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310428 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.853289:0:6522:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310428 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.853294:0:6522:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310428 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789120999.853314:0:6522:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789120999.853446:0:6522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913fd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+26:12771:x1876028947546496:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 714us (3929us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1789120999.853455:0:6522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 62 00000020:00080000:3.0:1789120999.853461:0:6522:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789120999.854230:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789120999.854240:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310428 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.854249:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789120999.854254:0:8449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310428 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.854263:0:8449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310428 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.854295:0:8449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:0.0:1789120999.854298:0:8449:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789120999.854304:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310428 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.854310:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310428 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6522 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789120999.854327:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120999.854329:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789120999.854331:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789120999.921407:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789120999.921628:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947546880 00000100:00100000:1.0:1789120999.921641:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947546880 00000100:00100000:1.0:1789120999.921734:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 249 00000100:00100000:1.0:1789120999.921747:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+26:12773:x1876028947546880:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:1.0:1789120999.921783:0:9342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789120999.921816:0:9342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a831042f lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed97 expref: -99 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.921992:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310436 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.922011:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310436 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.922024:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310436 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.922041:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a831043d lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.922049:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a831043d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.922055:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a831043d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.922141:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.922153:0:9342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed58 expref: 27 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.922163:0:9342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.922205:0:9342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed58 expref: 27 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.922250:0:9342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed58 expref: 27 pid: 11088 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120999.922269:0:9342:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970670592:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789120999.922403:0:9342:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b19540 going to sleep for 11 seconds 00000100:00100000:2.0:1789120999.940412:0:9342:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7061c0 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9342:1876028970670592:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789120999.940454:0:9342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789120999.940537:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789120999.940751:0:6522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947547136 00000100:00100000:3.0:1789120999.940760:0:6522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947547136 00000100:00100000:2.0:1789120999.940992:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:2.0:1789120999.941005:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+28:6183:x1876028947547136:12345-192.168.202.32@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789120999.941418:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:6183:x1876028947547136:12345-192.168.202.32@tcp:35:ldlm_bl.0 Request processed in 414us (882us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789120999.941427:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:3.0:1789120999.945194:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789120999.946118:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947547264 00000100:00100000:2.0:1789120999.946133:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947547264 00010000:00010000:2.0:1789120999.946195:0:9525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed58 expref: 29 pid: 11088 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789120999.946253:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 119 00000100:00100000:2.0:1789120999.946264:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:2412:x1876028947547264:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789120999.946283:0:9525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789120999.946292:0:9525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed58 expref: 29 pid: 11088 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.946308:0:9525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed58 expref: 29 pid: 11088 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.946361:0:9525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55600/0xb74d2367a831034f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed58 expref: 29 pid: 11088 timeout: 550 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.946383:0:9525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:2.0:1789120999.946389:0:9525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.946400:0:9525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.946409:0:9525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789120999.946455:0:9525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789120999.946541:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+28:2412:x1876028947547264:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 278us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789120999.946551:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 119 00010000:00010000:1.0:1789120999.947000:0:9342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947010:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789120999.947079:0:9342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789120999.947084:0:9342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789120999.947111:0:9342:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947128:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947139:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310436 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947147:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310436 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947155:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310436 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947163:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.947179:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310436 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947189:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310436 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947201:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:1.0:1789120999.947204:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120999.947209:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310436 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947216:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a8310436 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947230:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a831043d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947236:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a831043d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947242:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a831043d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947248:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789120999.947251:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a831043d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947257:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a831043d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947265:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9468852bff00) 00010000:00010000:1.0:1789120999.947268:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789120999.947279:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a831043d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947285:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d200/0xb74d2367a831043d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947335:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217de00/0xb74d2367a831042f lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed97 expref: 28 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947352:0:9342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed97 expref: 27 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789120999.947359:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:1.0:1789120999.947362:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789120999.947364:0:9342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217cc00, rc 0) 00000100:00100000:1.0:1789120999.947407:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12773:x1876028947546880:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 25663us (26015us total) trans 0 rc 0/0 00000100:00100000:1.0:1789120999.947417:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 249 00010000:00010000:1.0:1789121000.147924:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121000.850038:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789121000.850070:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970670720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121000.850173:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121000.850286:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970670720 00000100:00100000:2.0:1789121000.850295:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970670720 00000100:00100000:2.0:1789121000.850364:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789121000.850376:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970670720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121000.850427:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789121000.850509:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970670720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 135us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121000.850531:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1789121000.850596:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970670720:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121000.851224:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789121000.851237:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970670848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121000.851283:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121000.851330:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970670848 00000100:00100000:2.0:1789121000.851336:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970670848 00000100:00100000:2.0:1789121000.851369:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789121000.851377:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970670848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789121000.851409:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789121000.851451:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970670848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121000.851457:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1789121000.852036:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970670848:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789121000.853088:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789121000.853098:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789121000.853134:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789121000.853142:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789121000.853305:0:14508:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970670976:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789121000.853412:0:14508:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e13aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121000.860448:0:14508:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14508:1876028970670976:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789121000.865065:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121000.869422:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947547392 00000100:00100000:3.0:1789121000.869452:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947547392 00000100:00100000:3.0:1789121000.869561:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 250 00000100:00100000:3.0:1789121000.869573:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12784:x1876028947547392:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789121000.869644:0:6519:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789121000.870789:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ede00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12784:x1876028947547392:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 1211us (5731us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121000.870802:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 250 00000100:00100000:0.0:1789121000.883484:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121000.887098:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947547648 00000100:00100000:1.0:1789121000.887118:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947547648 00000100:00100000:1.0:1789121000.887201:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 251 00000100:00100000:1.0:1789121000.887213:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+27:12784:x1876028947547648:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789121000.887241:0:11088:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121000.887270:0:11088:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a831044b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ed9e expref: -99 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121000.887465:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a8310452 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121000.887485:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a8310452 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121000.887511:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a8310452 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121000.887528:0:11088:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789121000.891350:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d400/0xb74d2367a831044b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed9e expref: 30 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121000.891387:0:11088:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a8310452 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed9e expref: 29 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121000.891415:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:0.0:1789121000.891418:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789121000.891424:0:11088:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22400, rc 0) 00000100:00100000:0.0:1789121000.892497:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ecb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:12784:x1876028947547648:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 5271us (9014us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789121000.892511:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 251 00000100:00100000:3.0:1789121000.903858:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121000.903978:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947547904 00000100:00100000:2.0:1789121000.903992:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947547904 00000100:00100000:2.0:1789121000.904080:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 252 00000100:00100000:2.0:1789121000.904094:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:12784:x1876028947547904:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789121000.904589:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121000.904623:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947548032 00000100:00100000:3.0:1789121000.904628:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947548032 00000100:00100000:3.0:1789121000.904675:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:3.0:1789121000.904684:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:2411:x1876028947548032:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789121000.904716:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121000.904744:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22400/0xb74d2367a8310452 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed9e expref: 30 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121000.904777:0:6504:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:3.0:1789121000.904783:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121000.904876:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835e8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:2411:x1876028947548032:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 192us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121000.904885:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00010000:00010000:2.0:1789121000.907739:0:9342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a8310460 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121000.907784:0:9342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a8310460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121000.907802:0:9342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a8310460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121000.917863:0:9342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a8310460 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121000.917886:0:9342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a8310460 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121000.917894:0:9342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a8310460 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121000.917924:0:9342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3b800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121000.917929:0:9342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a8310460 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121000.917938:0:9342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a8310460 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121000.917960:0:9342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:3.0:1789121000.917964:0:9342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789121000.917970:0:9342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a8310460 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121000.917976:0:9342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3b800/0xb74d2367a8310460 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121000.918186:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:12784:x1876028947547904:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 14087us (14378us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789121000.918201:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 252 00000040:00080000:1.0:1789121000.918254:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789121000.918260:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789121000.919006:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789121000.919019:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789121000.928380:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121000.928952:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947548288 00000100:00100000:1.0:1789121000.928966:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947548288 00000100:00100000:1.0:1789121000.929045:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:1.0:1789121000.929058:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+29:12784:x1876028947548288:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789121000.929867:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:12784:x1876028947548288:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 807us (1500us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1789121000.929878:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 64 00000040:00080000:2.0:1789121000.997907:0:15472:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789121000.997924:0:15472:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789121000.997966:0:15472:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789121000.997973:0:15472:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789121001.176727:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121001.180712:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121001.183946:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947548544 00000100:00100000:0.0:1789121001.183967:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947548544 00000100:00100000:0.0:1789121001.184099:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 253 00000100:00100000:0.0:1789121001.184113:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+30:12797:x1876028947548544:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789121001.184150:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121001.184179:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310467 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eda5 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121001.184331:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831046e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121001.184351:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831046e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121001.184366:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831046e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121001.184382:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789121001.184522:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23a00/0xb74d2367a8310467 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eda5 expref: 33 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121001.184566:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831046e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eda5 expref: 32 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121001.184576:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:0.0:1789121001.184580:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789121001.184585:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22800, rc 0) 00000100:00100000:0.0:1789121001.184709:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:12797:x1876028947548544:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 599us (4022us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789121001.184718:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 253 00000100:00080000:1.0:1789121001.184976:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789121001.191149:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121001.191211:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947548672 00000100:00100000:3.0:1789121001.191224:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947548672 00000100:00100000:3.0:1789121001.191314:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 254 00000100:00100000:3.0:1789121001.191326:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:12797:x1876028947548672:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:3.0:1789121001.191420:0:11088:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831047c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121001.191442:0:11088:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831047c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121001.191475:0:11088:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831047c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121001.191713:0:11088:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831047c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121001.191722:0:11088:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831047c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121001.191730:0:11088:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831047c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121001.191737:0:11088:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a54600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121001.191744:0:11088:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831047c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121001.191754:0:11088:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831047c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121001.191771:0:11088:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:3.0:1789121001.191775:0:11088:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789121001.191781:0:11088:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831047c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121001.191788:0:11088:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831047c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 11088 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121001.192059:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:12797:x1876028947548672:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 732us (919us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121001.192069:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 254 00000100:00100000:0.0:1789121001.309677:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121001.309784:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947548800 00000100:00100000:1.0:1789121001.309797:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947548800 00000100:00080000:0.0:1789121001.310178:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789121001.310283:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:1.0:1789121001.310294:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947548800:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:1.0:1789121001.310319:0:8433:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121001.310348:0:8433:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a8310483 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7edac expref: -99 pid: 8433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789121001.310382:0:8433:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 13, mtime: 0x6aa3d1e6, atime: 0x6aa3d1e6, ctime: 0x6aa3d1e6, blocks: 0x8 00010000:00010000:1.0:1789121001.310410:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=451s v=(0 0) 00010000:00010000:1.0:1789121001.310417:0:8433:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121001.310430:0:8433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a8310483 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edac expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121001.310451:0:8433:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a8310483 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edac expref: 8 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121001.310495:0:8433:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d200, rc 0) 00000100:00100000:1.0:1789121001.310578:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947548800:12345-192.168.202.32@tcp:101:cat.0 Request processed in 286us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121001.310586:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 80 00000100:00100000:1.0:1789121001.313721:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121001.313858:0:8439:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947548928 00000100:00100000:2.0:1789121001.313871:0:8439:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947548928 00002000:00100000:2.0:1789121001.314105:0:8439:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9468bf705e00 x1876028947548928/t0(0) o3->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:532/0 lens 488/0 e 0 to 0 dl 1789121012 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789121001.314118:0:8439:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468bf705e00 with x1876028947548928 ext(0->4095) 00002000:00010000:2.0:1789121001.314124:0:8439:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468bf705e00 00000100:00100000:2.0:1789121001.314155:0:8439:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:2.0:1789121001.314163:0:8439:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf705e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947548928:12345-192.168.202.32@tcp:3:cat.0 00000100:00100000:2.0:1789121001.314521:0:8439:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf705e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947548928:12345-192.168.202.32@tcp:3:cat.0 Request processed in 356us (826us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789121001.314531:0:8439:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00002000:00100000:2.0:1789121001.314539:0:8439:0:(ofd_dev.c:2726:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x6:0x0] (0->4095) req@ffff9468bf705e00 x1876028947548928/t0(0) o3->3dde8702-0a22-4cb8-87f3-66b167299fdd@192.168.202.32@tcp:532/0 lens 488/4536 e 0 to 0 dl 1789121012 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789121001.314547:0:8439:0:(ofd_dev.c:2582:ofd_prolong_extent_locks()) Prolong locks for req ffff9468bf705e00 with x1876028947548928 ext(0->4095) 00002000:00010000:2.0:1789121001.314569:0:8439:0:(ofd_dev.c:2731:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9468bf705e00 00010000:00010000:3.0:1789121002.209201:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121002.898198:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970671104:0@lo:400:kworker.0 00000100:00100000:2.0:1789121002.898301:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121002.898468:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970671104 00000100:00100000:2.0:1789121002.898477:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970671104 00000100:00100000:2.0:1789121002.898538:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1789121002.898548:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970671104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121002.898619:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970671104:12345-0@lo:400:kworker.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121002.898628:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:2.0:1789121002.898701:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970671104:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.898918:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970671360:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.898959:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.898986:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970671872:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899011:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.899027:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970672384:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899049:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.899070:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1789121002.899075:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970671232:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899099:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.899115:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970671744:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899136:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.899151:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970672256:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899170:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.899197:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970671360 00000100:00100000:3.0:1789121002.899200:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970671360 00000100:00100000:3.0:1789121002.899234:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789121002.899241:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970671360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899284:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970671360:12345-0@lo:400:kworker.0 Request processed in 44us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.899291:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1789121002.899317:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970671872 00000100:00100000:3.0:1789121002.899320:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970671872 00000100:00100000:3.0:1789121002.899357:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970672384 00000100:00100000:3.0:1789121002.899360:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970672384 00000100:00100000:3.0:1789121002.899373:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970671232 00000100:00100000:3.0:1789121002.899375:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970671232 00000100:00100000:3.0:1789121002.899404:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970671744 00000100:00100000:3.0:1789121002.899407:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970671744 00000100:00100000:3.0:1789121002.899420:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970672256 00000100:00100000:3.0:1789121002.899423:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970672256 00000100:00100000:3.0:1789121002.899440:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789121002.899446:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970671872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899478:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970671872:12345-0@lo:400:kworker.0 Request processed in 33us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.899485:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1789121002.899498:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789121002.899503:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970672384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899530:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970672384:12345-0@lo:400:kworker.0 Request processed in 27us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.899536:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:3.0:1789121002.899546:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789121002.899551:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970671232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899578:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970671232:12345-0@lo:400:kworker.0 Request processed in 26us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.899584:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1789121002.899595:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789121002.899601:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970671744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899628:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970671744:12345-0@lo:400:kworker.0 Request processed in 27us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.899634:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:3.0:1789121002.899646:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789121002.899651:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970672256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899701:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970672256:12345-0@lo:400:kworker.0 Request processed in 49us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.899707:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1789121002.899769:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970671232:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899779:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970671744:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899788:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970672256:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899797:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970671360:0@lo:400:kworker.0 00010000:00080000:3.0:1789121002.899809:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d12c0 x1876028970671872/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121002.899846:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970671872:0@lo:400:kworker.0 00010000:00080000:3.0:1789121002.899857:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d30c0 x1876028970672384/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121002.899864:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970672384:0@lo:400:kworker.0 00000100:00080000:3.0:1789121002.899898:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789121002.899903:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121002.899912:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970671616:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899942:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.899962:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970672128:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.899987:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.900006:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970672640:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.900027:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.900046:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1789121002.900060:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970671488:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.900086:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.900102:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970672000:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.900123:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.900139:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970672512:0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.900159:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121002.900188:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970671616 00000100:00100000:3.0:1789121002.900192:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970671616 00000100:00100000:2.0:1789121002.900553:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970672768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789121002.900587:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121002.900611:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789121002.900617:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970672896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789121002.900639:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121002.900703:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970672768 00000100:00100000:2.0:1789121002.900708:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970672768 00000100:00100000:2.0:1789121002.900746:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970672896 00000100:00100000:2.0:1789121002.900749:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970672896 00000100:00100000:2.0:1789121002.900766:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789121002.900772:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970672768:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789121002.900802:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789121002.901206:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970672768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 432us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121002.901214:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789121002.901235:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789121002.901241:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876028970672896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789121002.901251:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1789121002.901276:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876028970672896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 36us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121002.901282:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789121002.901305:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970673024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789121002.901332:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121002.901364:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970673024 00000100:00100000:2.0:1789121002.901368:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970673024 00000100:00100000:2.0:1789121002.901393:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789121002.901398:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876028970673024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789121002.901420:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789121002.901453:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1876028970673024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 54us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121002.901459:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1789121002.901476:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789121002.901480:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121002.901513:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970673024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789121002.901636:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789121002.901646:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970671616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.901719:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970671616:12345-0@lo:400:kworker.0 Request processed in 75us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.901726:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1789121002.901752:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970672128 00000100:00100000:3.0:1789121002.901755:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970672128 00000100:00100000:3.0:1789121002.901774:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970672640 00000100:00100000:3.0:1789121002.901777:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970672640 00000100:00100000:3.0:1789121002.901789:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970672000 00000100:00100000:3.0:1789121002.901792:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970672000 00000100:00100000:3.0:1789121002.901802:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970672512 00000100:00100000:3.0:1789121002.901805:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970672512 00000100:00100000:3.0:1789121002.901857:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789121002.901864:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876028970672128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.901895:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d12c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876028970672128:12345-0@lo:400:kworker.0 Request processed in 32us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.901902:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789121002.901914:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789121002.901919:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876028970672640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.901950:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d2940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3647:x1876028970672640:12345-0@lo:400:kworker.0 Request processed in 31us (1922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.901956:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1789121002.901969:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789121002.901974:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970672000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.902000:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970672000:12345-0@lo:400:kworker.0 Request processed in 26us (1876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.902005:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789121002.902016:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789121002.902021:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970672512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.902059:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970672512:12345-0@lo:400:kworker.0 Request processed in 38us (1899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.902065:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1789121002.902094:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789121002.902116:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970671488 00000100:00100000:3.0:1789121002.902120:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970671488 00000100:00100000:3.0:1789121002.902147:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1789121002.902154:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970671488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121002.902187:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970671488:12345-0@lo:400:kworker.0 Request processed in 34us (2101us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.902195:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:2.0:1789121002.902383:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970671488:0@lo:400:kworker.0 00000100:00100000:2.0:1789121002.902395:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970672000:0@lo:400:kworker.0 00000100:00100000:2.0:1789121002.902405:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970672512:0@lo:400:kworker.0 00000100:00100000:2.0:1789121002.902415:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970671616:0@lo:400:kworker.0 00000100:00100000:2.0:1789121002.902427:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970672128:0@lo:400:kworker.0 00000100:00100000:2.0:1789121002.902448:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970672640:0@lo:400:kworker.0 00000100:00100000:1.0:1789121002.902996:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970672768:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789121002.903024:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970672896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789121002.961268:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121002.961332:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121002.961361:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121002.961383:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121002.961401:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121002.961436:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121002.961461:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121002.961497:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947549184 00000100:00100000:3.0:1789121002.961510:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947549184 00000100:00100000:3.0:1789121002.961586:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947549312 00000100:00100000:3.0:1789121002.961589:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947549312 00000100:00100000:3.0:1789121002.961614:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947549696 00000100:00100000:3.0:1789121002.961617:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947549696 00000100:00100000:3.0:1789121002.961632:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947549824 00000100:00100000:3.0:1789121002.961634:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947549824 00000100:00100000:3.0:1789121002.961652:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 392 00000100:00100000:3.0:1789121002.961662:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:2412:x1876028947549184:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121002.961774:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+32:2412:x1876028947549184:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 113us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.961783:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 392 00000100:00100000:3.0:1789121002.961806:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 393 00000100:00100000:3.0:1789121002.961812:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947549312:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121002.961883:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947549312:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 70us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.961890:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 393 00000100:00100000:3.0:1789121002.961904:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 394 00000100:00100000:3.0:1789121002.961909:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947549696:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121002.961933:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947549696:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 24us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.961939:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 394 00000100:00100000:3.0:1789121002.961951:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 395 00000100:00100000:3.0:1789121002.961965:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947549824:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121002.961991:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947549824:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.961998:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 395 00000100:00100000:3.0:1789121002.962024:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947549440 00000100:00100000:3.0:1789121002.962028:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947549440 00000100:00100000:3.0:1789121002.962055:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947549568 00000100:00100000:3.0:1789121002.962058:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947549568 00000100:00100000:3.0:1789121002.962078:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 135 00000100:00100000:3.0:1789121002.962084:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947549440:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121002.962112:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+8:2412:x1876028947549440:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.962119:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 135 00000100:00100000:3.0:1789121002.962130:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 136 00000100:00100000:3.0:1789121002.962137:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947549568:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121002.962159:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947549568:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 23us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121002.962164:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 136 00000100:00080000:3.0:1789121002.962200:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789121002.962205:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789121002.962207:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789121002.962672:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947549056 00000100:00100000:1.0:1789121002.962688:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947549056 00000100:00100000:1.0:1789121002.962729:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 466 00000100:00100000:1.0:1789121002.962737:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947549056:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789121002.962771:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947549056:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 35us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121002.962778:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 466 00010000:00010000:2.0:1789121003.221025:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121003.411319:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970673152:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789121003.411437:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121003.411562:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970673152 00000100:00100000:1.0:1789121003.411573:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970673152 00000100:00100000:1.0:1789121003.411654:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1789121003.411668:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970673152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789121003.411710:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42380992 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789121003.411787:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970673152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 122us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121003.411798:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789121003.412574:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970673152:0@lo:13:osp-pre-1-1.0 00000001:00080000:2.0:1789121003.926783:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1789121003.926805:0:9516:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00010000:00010000:0.0:1789121004.253765:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121005.272675:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121005.970062:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789121005.970101:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970673280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121005.970210:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121005.970303:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970673280 00000100:00100000:2.0:1789121005.970312:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970673280 00000100:00100000:2.0:1789121005.970388:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789121005.970400:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970673280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789121005.970459:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789121005.970519:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970673280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121005.970528:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1789121005.970590:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970673280:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789121005.971088:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789121005.971101:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970673408:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121005.971143:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121005.971205:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970673408 00000100:00100000:3.0:1789121005.971210:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970673408 00000100:00100000:3.0:1789121005.971242:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789121005.971256:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970673408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789121005.971280:0:6524:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789121005.971319:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970673408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 65us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121005.971326:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1789121005.971370:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970673408:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1789121005.982325:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789121005.982387:0:6497:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff946783118600 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1789121005.982395:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9467810ffd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff946783118d80 00000020:00080000:0.0:1789121005.982399:0:6497:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9468afddb400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff946782a8ca00 00000020:00080000:0.0:1789121005.982433:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1789121005.982498:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789121005.982601:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1789121005.982872:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121005.982886:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121005.982895:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121005.982902:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3ba00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121005.982908:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121005.982917:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121005.982952:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9468c1bd2800) 00010000:00010000:3.0:1789121005.982956:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121005.982961:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121005.982968:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783c3ba00/0xb74d2367a83103fe lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6518 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789121005.984144:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:2.0:1789121005.984162:0:8428:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:3.0:1789121006.289989:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121006.572422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121006.572952:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947549952 00000100:00100000:3.0:1789121006.572967:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947549952 00000100:00100000:3.0:1789121006.573084:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 255 00000100:00100000:3.0:1789121006.573095:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:12450:x1876028947549952:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789121006.573256:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:12450:x1876028947549952:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 Request processed in 162us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121006.573265:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 255 00000100:00080000:0.0:1789121006.573562:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789121006.583488:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121006.583642:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947550080 00000100:00100000:3.0:1789121006.583664:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947550080 00000100:00100000:3.0:1789121006.583784:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 256 00000100:00100000:3.0:1789121006.583806:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:12450:x1876028947550080:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1789121006.584008:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:12450:x1876028947550080:12345-192.168.202.32@tcp:60:lhsmtool_posix.0 Request processed in 213us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121006.584019:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 256 00000100:00080000:0.0:1789121006.584749:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789121006.589964:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121006.590416:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947550336 00000100:00100000:1.0:1789121006.590431:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947550336 00000100:00100000:1.0:1789121006.590522:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:1.0:1789121006.590535:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:12450:x1876028947550336:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789121006.591258:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:12450:x1876028947550336:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 721us (1477us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789121006.591270:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 65 00000100:00100000:2.0:1789121006.858716:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121006.858873:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947550464 00000100:00100000:3.0:1789121006.858887:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947550464 00000100:00100000:3.0:1789121006.858995:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 257 00000100:00100000:3.0:1789121006.859007:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:13254:x1876028947550464:12345-192.168.202.32@tcp:101:lsof.0 00010000:00010000:3.0:1789121006.859035:0:6519:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121006.859064:0:6519:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831048a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7edb3 expref: -99 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121006.859157:0:6519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310491 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121006.859200:0:6519:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121006.859218:0:6519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789121006.859282:0:6519:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789121006.859287:0:6519:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789121006.859324:0:6519:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310491 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6519 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121006.859356:0:6519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54600/0xb74d2367a831048a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edb3 expref: 7 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121006.859379:0:6519:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310491 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edb3 expref: 6 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121006.859389:0:6519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468a3998700) 00010000:00010000:3.0:1789121006.859392:0:6519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789121006.859396:0:6519:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54c00, rc 0) 00000100:00100000:3.0:1789121006.859486:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:13254:x1876028947550464:12345-192.168.202.32@tcp:101:lsof.0 Request processed in 481us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121006.859496:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 257 00000100:00080000:0.0:1789121006.859599:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789121007.058808:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789121007.058860:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789121007.058991:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1789121007.059001:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789121007.315997:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121007.442610:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789121008.018253:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789121008.018289:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970673536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789121008.018410:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121008.018976:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970673536 00000100:00100000:2.0:1789121008.018999:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970673536 00000100:00100000:2.0:1789121008.019087:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1789121008.019101:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970673536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789121008.019144:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789121008.019218:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970673536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121008.019227:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:0.0:1789121008.021463:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789121008.021543:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789121008.021565:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:0.0:1789121008.021593:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946783d1e580, transno 4294967311 00000100:00100000:0.0:1789121008.021652:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970673536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789121008.022855:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789121008.022877:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970673664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789121008.022972:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121008.023049:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970673664 00000100:00100000:2.0:1789121008.023059:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970673664 00000100:00100000:2.0:1789121008.023136:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789121008.023150:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970673664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789121008.023191:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789121008.023205:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970673792:0@lo:400:kworker.0 00000100:00080000:0.0:1789121008.023334:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789121008.023519:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970673920:0@lo:400:kworker.0 00000100:00100000:0.0:1789121008.027919:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970674176:0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.029441:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970673664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 6281us (6455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121008.029461:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1789121008.029555:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970674048:0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.029652:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121008.029709:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970674560:0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.029740:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121008.029773:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970675072:0@lo:400:kworker.0 00000100:00100000:3.0:1789121008.029786:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121008.029807:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121008.029870:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970674304:0@lo:400:kworker.0 00000100:00100000:3.0:1789121008.029899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121008.029912:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970673664:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789121008.029920:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970674816:0@lo:400:kworker.0 00000100:00100000:3.0:1789121008.029945:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121008.029964:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970674048 00000100:00100000:2.0:1789121008.029981:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970674048 00000100:00100000:3.0:1789121008.029992:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970673792 00000100:00100000:3.0:1789121008.029997:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970673792 00000100:00100000:3.0:1789121008.030033:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1789121008.030038:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970674304 00000100:00100000:3.0:1789121008.030042:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970673792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.030044:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970674304 00000100:00100000:2.0:1789121008.030069:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789121008.030078:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970674048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121008.030095:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3644:x1876028970673792:12345-0@lo:400:kworker.0 Request processed in 54us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121008.030100:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00000100:00100000:3.0:1789121008.030135:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970675072 00000100:00100000:3.0:1789121008.030139:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970675072 00000100:00100000:2.0:1789121008.030140:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970674048:12345-0@lo:400:kworker.0 Request processed in 61us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121008.030150:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789121008.030169:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1789121008.030180:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789121008.030181:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970674304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121008.030192:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970675072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.030219:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970674304:12345-0@lo:400:kworker.0 Request processed in 43us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121008.030226:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1789121008.030260:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970674048:0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.030303:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970674560 00000100:00100000:2.0:1789121008.030308:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970674560 00000100:00100000:2.0:1789121008.030340:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970674816 00000100:00100000:2.0:1789121008.030343:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970674816 00000100:00100000:2.0:1789121008.030364:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1789121008.030371:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970674560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121008.030401:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789121008.030416:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970674560:12345-0@lo:400:kworker.0 Request processed in 43us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121008.030417:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970674816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.030430:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00080000:2.0:1789121008.030464:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784b2de00 x1876028970674560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121008.030470:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970674816:12345-0@lo:400:kworker.0 Request processed in 60us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121008.030482:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1789121008.030489:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970674560:0@lo:400:kworker.0 00000100:00100000:1.0:1789121008.030531:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789121008.030541:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789121008.030548:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789121008.030551:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789121008.030570:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970673792:0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.030582:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970674304:0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.030592:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970674816:0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.030624:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970673920 00000100:00100000:2.0:1789121008.030628:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970673920 00000100:00100000:2.0:1789121008.030664:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1789121008.030670:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf707840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970673920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.033861:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf707840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970673920:12345-0@lo:400:kworker.0 Request processed in 3175us (3314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121008.033880:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970673920:0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.033882:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:1.0:1789121008.033899:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970674432:0@lo:400:kworker.0 00000100:00100000:1.0:1789121008.033954:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121008.033995:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970674432 00000100:00100000:2.0:1789121008.034004:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970674432 00000100:00100000:1.0:1789121008.034008:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970674944:0@lo:400:kworker.0 00000100:00100000:1.0:1789121008.034031:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121008.034046:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970674944 00000100:00100000:1.0:1789121008.034050:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970674944 00000100:00100000:2.0:1789121008.034076:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789121008.034082:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1789121008.034090:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970674432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121008.034094:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970674944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.034153:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1876028970674432:12345-0@lo:400:kworker.0 Request processed in 68us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121008.034162:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970674944:12345-0@lo:400:kworker.0 Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121008.034163:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:1.0:1789121008.034172:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00000100:00080000:2.0:1789121008.034190:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789121008.034197:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789121008.034359:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d2580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970675072:12345-0@lo:400:kworker.0 Request processed in 4170us (4554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121008.034368:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789121008.034451:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789121008.034503:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99c7480 x1876028970674944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121008.034520:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970674944:0@lo:400:kworker.0 00000100:00100000:1.0:1789121008.034674:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3645:1876028970674432:0@lo:400:kworker.0 00000100:00100000:0.0:1789121008.034792:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970674688:0@lo:400:kworker.0 00000100:00100000:0.0:1789121008.034855:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121008.034863:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970675072:0@lo:400:kworker.0 00000100:00100000:0.0:1789121008.034890:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970675200:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121008.034912:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121008.035013:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970675200 00000100:00100000:2.0:1789121008.035018:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970675200 00000100:00100000:2.0:1789121008.035088:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1789121008.035109:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970675200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789121008.035133:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789121008.035167:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970674688 00000100:00100000:1.0:1789121008.035171:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970674688 00000100:00100000:2.0:1789121008.035179:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ee580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970675200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121008.035188:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789121008.035217:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789121008.035227:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970674688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121008.035260:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ed2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970674688:12345-0@lo:400:kworker.0 Request processed in 37us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121008.035265:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:0.0:1789121008.035419:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121008.035428:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970674176 00000100:00100000:3.0:1789121008.035433:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970674176 00000100:00100000:0.0:1789121008.035443:0:3647:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1789121008.035451:0:3647:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9468914df0c0, transno 4294967323 00000100:00100000:3.0:1789121008.035468:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1789121008.035475:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970674176:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1789121008.035475:0:3647:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1789121008.035506:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970674688:0@lo:400:kworker.0 00000100:00100000:0.0:1789121008.042229:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970675200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789121008.042279:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839eed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970674176:12345-0@lo:400:kworker.0 Request processed in 6719us (7743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121008.042296:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00000100:00100000:0.0:1789121008.043165:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970674176:0@lo:400:kworker.0 00000100:00100000:2.0:1789121008.083440:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121008.084371:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121008.084412:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121008.084434:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121008.084460:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121008.084482:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121008.084517:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121008.084561:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947550848 00000100:00100000:2.0:1789121008.084574:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947550848 00000100:00100000:2.0:1789121008.084662:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947551360 00000100:00100000:2.0:1789121008.084666:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947551360 00000100:00100000:2.0:1789121008.084681:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947550720 00000100:00100000:2.0:1789121008.084683:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947550720 00000100:00100000:2.0:1789121008.084697:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947551232 00000100:00100000:2.0:1789121008.084700:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947551232 00000100:00100000:2.0:1789121008.084716:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 402 00000100:00100000:2.0:1789121008.084726:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947550848:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789121008.085057:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 403 00000100:00100000:1.0:1789121008.085068:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947551360:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789121008.085150:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947551360:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 84us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121008.085159:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 403 00000100:00100000:1.0:1789121008.085183:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 404 00000100:00100000:1.0:1789121008.085189:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:2412:x1876028947550720:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789121008.085228:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:2412:x1876028947550720:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 39us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121008.085263:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 404 00000100:00100000:1.0:1789121008.085278:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 405 00000100:00100000:1.0:1789121008.085285:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947551232:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789121008.085312:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947551232:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121008.085318:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 405 00000100:00080000:1.0:1789121008.085385:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789121008.085391:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789121008.085476:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947550848:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 749us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121008.085484:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 402 00000100:00100000:3.0:1789121008.086267:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947551104 00000100:00100000:3.0:1789121008.086275:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947551104 00000100:00080000:1.0:1789121008.086368:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789121008.086399:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947550976 00000100:00100000:1.0:1789121008.086403:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947550976 00000100:00100000:1.0:1789121008.086447:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 139 00000100:00100000:1.0:1789121008.086456:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947550976:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789121008.086518:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947550976:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 51us (2023us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121008.086526:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 139 00000100:00080000:1.0:1789121008.086554:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121008.091459:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947550592 00000100:00100000:0.0:1789121008.091481:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947550592 00000100:00100000:0.0:1789121008.091599:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 468 00000100:00100000:0.0:1789121008.091612:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947550592:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121008.091745:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947550592:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 134us (8320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121008.091775:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 468 00000100:00100000:1.0:1789121008.092671:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 140 00000100:00100000:1.0:1789121008.092690:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947551104:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789121008.092758:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947551104:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 76us (8346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121008.092765:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 140 00010000:00010000:0.0:1789121008.343576:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121008.531058:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789121008.531095:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970675328:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789121008.531220:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121008.531417:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970675328 00000100:00100000:3.0:1789121008.531426:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970675328 00000100:00100000:3.0:1789121008.531498:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1789121008.531511:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970675328:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789121008.531551:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789121008.531636:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970675328:12345-0@lo:13:osp-pre-1-1.0 Request processed in 118us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121008.531644:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789121008.531982:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ecf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970675328:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789121009.363109:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121010.386415:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789121010.994703:0:15669:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 06:03:28 (1789121008) 00000100:00100000:3.0:1789121011.091983:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970675456:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789121011.092057:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121011.092221:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970675456 00000100:00100000:2.0:1789121011.092229:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970675456 00000100:00100000:2.0:1789121011.092275:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789121011.092299:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970675456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789121011.092338:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1789121011.092387:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970675456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121011.092394:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789121011.092419:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970675584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121011.092445:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121011.092479:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970675584 00000100:00100000:2.0:1789121011.092483:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970675584 00000100:00100000:2.0:1789121011.092627:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1789121011.092639:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970675584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121011.092661:0:12532:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1789121011.092704:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970675584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 68us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121011.092710:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1789121011.092946:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970675584:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121011.093009:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970675456:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789121011.410152:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789121011.609221:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:0.0:1789121011.609234:0:6497:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1789121011.609273:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789121011.609289:0:6550:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:0.0:1789121012.434989:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121013.138181:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970675840:0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.138253:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121013.138322:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970676352:0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.138346:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121013.138366:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970676864:0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.138384:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121013.138405:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789121013.138410:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970675968:0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.138451:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121013.138470:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970676480:0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.138506:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121013.138521:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970676992:0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.138538:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121013.138568:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970675968 00000100:00100000:2.0:1789121013.138574:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970675968 00000100:00100000:2.0:1789121013.138625:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789121013.138633:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970675968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.138684:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970675968:12345-0@lo:400:kworker.0 Request processed in 51us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121013.138701:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789121013.138724:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970675840 00000100:00100000:2.0:1789121013.138728:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970675840 00000100:00100000:2.0:1789121013.138747:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970676352 00000100:00100000:2.0:1789121013.138749:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970676352 00000100:00100000:2.0:1789121013.138766:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970676864 00000100:00100000:2.0:1789121013.138769:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970676864 00000100:00100000:2.0:1789121013.138778:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970676480 00000100:00100000:2.0:1789121013.138780:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970676480 00000100:00100000:2.0:1789121013.138791:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970676992 00000100:00100000:2.0:1789121013.138793:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970676992 00000100:00100000:2.0:1789121013.138806:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1789121013.138811:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946889570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970675840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.138865:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946889570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970675840:12345-0@lo:400:kworker.0 Request processed in 53us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121013.138871:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:2.0:1789121013.138883:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1789121013.138894:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946889573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970676352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.138919:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946889573840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970676352:12345-0@lo:400:kworker.0 Request processed in 26us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121013.138925:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:2.0:1789121013.138936:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1789121013.138941:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970676864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.138965:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970676864:12345-0@lo:400:kworker.0 Request processed in 24us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121013.138971:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:2.0:1789121013.138981:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1789121013.138986:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970676480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.139011:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970676480:12345-0@lo:400:kworker.0 Request processed in 25us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121013.139017:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1789121013.139027:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1789121013.139033:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970676992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.139056:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970676992:12345-0@lo:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121013.139061:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:2.0:1789121013.139097:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970675968:0@lo:400:kworker.0 00010000:00080000:2.0:1789121013.139109:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b27c00 x1876028970676480/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121013.139119:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b27c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970676480:0@lo:400:kworker.0 00010000:00080000:2.0:1789121013.139128:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b243c0 x1876028970676992/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121013.139142:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b243c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970676992:0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.139153:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970675840:0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.139161:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970676352:0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.139170:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b25680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970676864:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.139554:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970675712:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.139603:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121013.139636:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970676224:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.139661:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121013.139680:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970676736:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.139715:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121013.139733:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970677248:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.139752:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121013.139771:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789121013.139777:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970676096:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.139799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121013.139846:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970676608:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.139869:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121013.139884:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970677120:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.139904:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121013.139929:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970676096 00000100:00100000:1.0:1789121013.139934:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970676096 00000100:00100000:1.0:1789121013.139958:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:1.0:1789121013.139965:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf705a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970676096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.140001:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf705a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970676096:12345-0@lo:400:kworker.0 Request processed in 36us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121013.140015:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00080000:1.0:1789121013.140047:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789121013.140051:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789121013.140060:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970676224 00000100:00100000:1.0:1789121013.140063:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970676224 00000100:00100000:1.0:1789121013.140086:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789121013.140092:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970676224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.140125:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970676224:12345-0@lo:400:kworker.0 Request processed in 33us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121013.140132:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789121013.140148:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970676736 00000100:00100000:1.0:1789121013.140150:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970676736 00000100:00100000:1.0:1789121013.140174:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970677248 00000100:00100000:1.0:1789121013.140177:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970677248 00000100:00100000:1.0:1789121013.140187:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970676608 00000100:00100000:1.0:1789121013.140189:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970676608 00000100:00100000:1.0:1789121013.140198:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970677120 00000100:00100000:1.0:1789121013.140200:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970677120 00000100:00100000:1.0:1789121013.140211:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789121013.140216:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970676736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.140244:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970676736:12345-0@lo:400:kworker.0 Request processed in 28us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121013.140250:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789121013.140260:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789121013.140264:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf705680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970677248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.140287:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf705680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970677248:12345-0@lo:400:kworker.0 Request processed in 23us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121013.140293:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789121013.140440:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789121013.140446:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970676608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.140538:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970676608:12345-0@lo:400:kworker.0 Request processed in 28us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121013.140545:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789121013.140556:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789121013.140562:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970677120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.140599:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7061c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970677120:12345-0@lo:400:kworker.0 Request processed in 37us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121013.140606:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00080000:1.0:1789121013.140627:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789121013.140631:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789121013.140661:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970676096:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.140672:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970676608:0@lo:400:kworker.0 00000100:00100000:3.0:1789121013.140851:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789121013.140862:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970677376:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789121013.140894:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121013.140925:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970677376 00000100:00100000:3.0:1789121013.140930:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970677376 00000100:00100000:3.0:1789121013.140957:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789121013.140964:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970677376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789121013.140986:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789121013.141024:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970677376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121013.141030:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1789121013.141066:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970677376:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789121013.141138:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b261c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970677120:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.141154:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970676224:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.141164:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b252c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970676736:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.141176:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970677248:0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.141997:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970675712 00000100:00100000:2.0:1789121013.142003:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970675712 00000100:00100000:2.0:1789121013.142047:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 469 00000100:00100000:2.0:1789121013.142055:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970675712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121013.142108:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970675712:12345-0@lo:400:kworker.0 Request processed in 54us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121013.142115:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 469 00000100:00100000:0.0:1789121013.142430:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970677504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121013.142464:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121013.142544:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970677504 00000100:00100000:3.0:1789121013.142549:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970677504 00000100:00100000:3.0:1789121013.142576:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789121013.142606:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970677504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789121013.142620:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42294976 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1789121013.142713:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970675712:0@lo:400:kworker.0 00000100:00100000:1.0:1789121013.145159:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789121013.145186:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970677632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789121013.145262:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121013.146169:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970677632 00000100:00100000:2.0:1789121013.146181:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970677632 00000100:00100000:2.0:1789121013.146234:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1789121013.146245:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970677632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789121013.146279:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789121013.146349:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970677632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121013.146356:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789121013.146518:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970677632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789121013.151080:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970677504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8464us (8605us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121013.151097:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789121013.154494:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970677504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789121013.199374:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121013.199422:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121013.199476:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947551616 00000100:00100000:1.0:1789121013.199487:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947551616 00000100:00100000:2.0:1789121013.199500:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121013.199552:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947552128 00000100:00100000:1.0:1789121013.199556:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947552128 00000100:00100000:2.0:1789121013.199559:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121013.199598:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 412 00000100:00100000:2.0:1789121013.199605:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121013.199611:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:2412:x1876028947551616:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121013.199652:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121013.199695:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947551744 00000100:00100000:1.0:1789121013.199696:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:2412:x1876028947551616:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121013.199701:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947551744 00000100:00100000:1.0:1789121013.199708:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 412 00000100:00100000:1.0:1789121013.199729:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 413 00000100:00100000:1.0:1789121013.199737:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947552128:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121013.199747:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 414 00000100:00100000:0.0:1789121013.199758:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947551744:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789121013.199766:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2412:x1876028947552128:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121013.199773:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 413 00000100:00100000:0.0:1789121013.199798:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c383c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947551744:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121013.199806:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 414 00000100:00080000:0.0:1789121013.199851:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789121013.199856:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789121013.204376:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121013.204406:0:6510:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947551488 00000100:00100000:0.0:1789121013.204412:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947552256 00000100:00100000:2.0:1789121013.204415:0:6510:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947551488 00000100:00100000:0.0:1789121013.204416:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947552256 00000100:00100000:2.0:1789121013.204460:0:6510:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 470 00000100:00100000:0.0:1789121013.204460:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 415 00000100:00100000:2.0:1789121013.204470:0:6510:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947551488:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121013.204470:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947552256:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121013.204616:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2412:x1876028947552256:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 66us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121013.204634:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 415 00000100:00080000:0.0:1789121013.204657:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789121013.204751:0:6510:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947551488:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 282us (5193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121013.204759:0:6510:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 470 00000100:00100000:3.0:1789121013.205522:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947551872 00000100:00100000:3.0:1789121013.205529:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947551872 00000100:00100000:1.0:1789121013.205532:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947552000 00000100:00100000:1.0:1789121013.205539:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947552000 00000100:00080000:0.0:1789121013.205576:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789121013.205591:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789121013.205611:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:1.0:1789121013.205621:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947552000:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121013.205629:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 146 00000100:00100000:3.0:1789121013.205640:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947551872:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789121013.205682:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2412:x1876028947552000:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 61us (6027us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121013.205683:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2412:x1876028947551872:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 42us (6257us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121013.205697:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:3.0:1789121013.205710:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 146 00010000:00010000:0.0:1789121013.459314:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121013.652529:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970677760:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789121013.652638:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121013.653129:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970677760 00000100:00100000:2.0:1789121013.653137:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970677760 00000100:00100000:2.0:1789121013.653205:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789121013.653216:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970677760:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789121013.653252:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1789121013.653310:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fa1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970677760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121013.653318:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789121013.655741:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467839ed680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970677760:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1789121014.482241:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121014.932703:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121014.932813:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947552512 00000100:00100000:1.0:1789121014.932856:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947552512 00000100:00100000:1.0:1789121014.932915:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:1.0:1789121014.932927:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+18:13478:x1876028947552512:12345-192.168.202.32@tcp:35:umount.0 00000100:00100000:1.0:1789121014.933207:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:13478:x1876028947552512:12345-192.168.202.32@tcp:35:umount.0 Request processed in 282us (513us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789121014.933217:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:0.0:1789121014.941053:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121014.942210:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947552768 00000100:00100000:1.0:1789121014.942225:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947552768 00000100:00100000:1.0:1789121014.942292:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:1.0:1789121014.942303:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+19:13478:x1876028947552768:12345-192.168.202.32@tcp:35:umount.0 00000100:00100000:1.0:1789121014.942612:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:13478:x1876028947552768:12345-192.168.202.32@tcp:35:umount.0 Request processed in 311us (1575us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789121014.942621:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:0.0:1789121014.945417:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121014.945515:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947553024 00000100:00100000:1.0:1789121014.945525:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947553024 00000100:00100000:1.0:1789121014.945587:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:1.0:1789121014.945597:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468913fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+20:13478:x1876028947553024:12345-192.168.202.32@tcp:35:umount.0 00000100:00100000:1.0:1789121014.945889:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468913fec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:13478:x1876028947553024:12345-192.168.202.32@tcp:35:umount.0 Request processed in 292us (480us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789121014.945898:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:2.0:1789121014.950809:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121014.951163:0:6521:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947553280 00000100:00100000:1.0:1789121014.951173:0:6521:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947553280 00000100:00100000:1.0:1789121014.951232:0:6521:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:1.0:1789121014.951242:0:6521:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:13478:x1876028947553280:12345-192.168.202.32@tcp:35:umount.0 00000100:00100000:1.0:1789121014.951676:0:6521:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:13478:x1876028947553280:12345-192.168.202.32@tcp:35:umount.0 Request processed in 434us (875us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1789121014.951685:0:6521:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:0.0:1789121014.969919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121014.969973:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121014.970007:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121014.970126:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947553408 00000100:00100000:3.0:1789121014.970137:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947553408 00000100:00100000:3.0:1789121014.970201:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947553664 00000100:00100000:3.0:1789121014.970204:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947553664 00000100:00100000:3.0:1789121014.970223:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947553536 00000100:00100000:3.0:1789121014.970226:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947553536 00000100:00100000:3.0:1789121014.970243:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789121014.970252:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75b5d71e-0e31-479d-b240-b6a98d05b974+15:2412:x1876028947553408:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789121014.970268:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121014.970288:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c2048a00/0xb74d2367a830f3ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8ea expref: 15 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121014.970305:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121014.970353:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75b5d71e-0e31-479d-b240-b6a98d05b974+14:2412:x1876028947553408:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 102us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121014.970379:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789121014.970396:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789121014.970402:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75b5d71e-0e31-479d-b240-b6a98d05b974+13:2412:x1876028947553664:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789121014.970409:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121014.970419:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1600/0xb74d2367a830f6bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9df expref: 13 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121014.970428:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121014.970445:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75b5d71e-0e31-479d-b240-b6a98d05b974+12:2412:x1876028947553664:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 42us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121014.970452:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789121014.970463:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:3.0:1789121014.970469:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75b5d71e-0e31-479d-b240-b6a98d05b974+11:2412:x1876028947553536:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789121014.970475:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121014.970483:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468a2f11e00/0xb74d2367a830f311 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8ab expref: 11 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121014.970492:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121014.970507:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ed680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75b5d71e-0e31-479d-b240-b6a98d05b974+10:2412:x1876028947553536:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 38us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121014.970512:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:0.0:1789121014.973602:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121014.974134:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947553792 00000100:00100000:2.0:1789121014.974142:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947553792 00000100:00100000:2.0:1789121014.974207:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 81 00000100:00100000:2.0:1789121014.974217:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783eca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2408:x1876028947553792:12345-192.168.202.32@tcp:9:umount.0 00000020:00000080:2.0:1789121014.974245:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f786 00000100:00080000:2.0:1789121014.974254:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9468853f9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789121014.974305:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:2.0:1789121014.974469:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783eca940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+2:2408:x1876028947553792:12345-192.168.202.32@tcp:9:umount.0 Request processed in 253us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121014.974490:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 81 00010000:00010000:0.0:1789121014.974555:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121014.982657:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121014.982805:0:8433:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947554176 00000100:00100000:1.0:1789121014.982814:0:8433:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947554176 00000100:00100000:1.0:1789121014.982908:0:8433:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 82 00000100:00100000:1.0:1789121014.982918:0:8433:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+7:2408:x1876028947554176:12345-192.168.202.32@tcp:9:umount.0 00000020:00000080:1.0:1789121014.982951:0:8433:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f9fc 00000020:00010000:1.0:1789121014.982960:0:8433:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9467849b3000: total 0 00000100:00080000:1.0:1789121014.982965:0:8433:0:(import.c:65:import_set_state_nolock()) ffff9467849b6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789121014.983016:0:8433:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000020:00010000:0.0:1789121014.983191:0:8450:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9467849b3000: total 0 00010000:00010000:0.0:1789121014.983236:0:8450:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9467849b3000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1789121014.983294:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000083a2f2d7/0xb74d2367a8310483 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edac expref: 6 pid: 8433 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121014.983331:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a830fdb4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebc9 expref: 5 pid: 8434 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121014.983345:0:8450:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9467849b3000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1789121014.983357:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121014.983359:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121014.983361:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121014.983532:0:8433:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3dde8702-0a22-4cb8-87f3-66b167299fdd+2:2408:x1876028947554176:12345-192.168.202.32@tcp:9:umount.0 Request processed in 614us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121014.983541:0:8433:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 82 00000100:00100000:3.0:1789121015.003921:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121015.004087:0:6519:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947555200 00000100:00100000:0.0:1789121015.004097:0:6519:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947555200 00000100:00100000:0.0:1789121015.004181:0:6519:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 258 00000100:00100000:0.0:1789121015.004209:0:6519:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+22:2408:x1876028947555200:12345-192.168.202.32@tcp:39:umount.0 00000020:00000080:0.0:1789121015.004243:0:6519:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f31f 00000020:00010000:0.0:1789121015.004260:0:6519:0:(genops.c:1921:obd_stale_export_put()) Put export ffff946783061800: total 0 00000100:00080000:0.0:1789121015.004264:0:6519:0:(import.c:65:import_set_state_nolock()) ffff946783061000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789121015.004294:0:6519:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1789121015.004444:0:6519:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3dde8702-0a22-4cb8-87f3-66b167299fdd+21:2408:x1876028947555200:12345-192.168.202.32@tcp:39:umount.0 Request processed in 237us (533us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789121015.004452:0:6519:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 258 00000100:00080000:2.0:1789121015.004613:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1789121015.004810:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff946783061800: total 0 00010000:00010000:3.0:1789121015.004900:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946783061800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789121015.004933:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789121015.004944:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789121015.004952:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a830fa57 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eae2 expref: 20 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.004971:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff94678280a700) 00010000:00010000:3.0:1789121015.004974:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121015.004977:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2800/0xb74d2367a830f701 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9f4 expref: 19 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.004995:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:3.0:1789121015.004998:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789121015.005001:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217c000/0xb74d2367a8310364 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed5f expref: 18 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.005013:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:3.0:1789121015.005016:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789121015.005019:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22000/0xb74d2367a830fd9f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebc2 expref: 17 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.005029:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:3.0:1789121015.005032:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789121015.005035:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23200/0xb74d2367a830fc95 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eb7c expref: 16 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.005058:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9468c1bfa500) 00010000:00010000:3.0:1789121015.005061:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789121015.005064:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e23c00/0xb74d2367a830f6e5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9ed expref: 15 pid: 6518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.005091:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789121015.005093:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789121015.005097:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0600/0xb74d2367a830fe39 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebec expref: 14 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.005108:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:3.0:1789121015.005111:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789121015.005114:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22800/0xb74d2367a831046e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eda5 expref: 13 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.005124:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9468c1bfa200) 00010000:00010000:3.0:1789121015.005126:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789121015.005129:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468a2f10800/0xb74d2367a830f75c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ea09 expref: 12 pid: 6520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.005141:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9468852bf700) 00010000:00010000:3.0:1789121015.005143:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789121015.005147:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217cc00/0xb74d2367a8310444 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ed97 expref: 11 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.005161:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468a3998700) 00010000:00010000:3.0:1789121015.005163:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789121015.005167:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54400/0xb74d2367a830fe1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebe5 expref: 10 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.005179:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9468a3b96800) 00010000:00010000:3.0:1789121015.005181:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789121015.005191:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946783e22a00/0xb74d2367a830fd75 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ebb4 expref: 9 pid: 11088 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.005208:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9468886f6a00) 00010000:00010000:3.0:1789121015.005211:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789121015.005214:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310126 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ecc5 expref: 8 pid: 9342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121015.005226:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946783061800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1789121015.005242:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121015.005244:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121015.005245:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121015.044427:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121015.044541:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947555328 00000100:00100000:1.0:1789121015.044551:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947555328 00000100:00100000:1.0:1789121015.044662:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 259 00000100:00100000:1.0:1789121015.044673:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+5:2408:x1876028947555328:12345-192.168.202.32@tcp:39:umount.0 00000020:00000080:1.0:1789121015.044710:0:9342:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f326 00000100:00080000:1.0:1789121015.044727:0:9342:0:(import.c:65:import_set_state_nolock()) ffff9468bf6ae000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789121015.044878:0:9342:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1789121015.045036:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3dde8702-0a22-4cb8-87f3-66b167299fdd+3:2408:x1876028947555328:12345-192.168.202.32@tcp:39:umount.0 Request processed in 365us (620us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1789121015.045045:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 259 00000100:00080000:2.0:1789121015.045274:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1789121015.050014:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121015.506079:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121016.210318:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970677888:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789121016.210413:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121016.210676:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970678016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121016.210709:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121016.210857:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970677888 00000100:00100000:3.0:1789121016.210867:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970677888 00000100:00100000:3.0:1789121016.210917:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970678016 00000100:00100000:3.0:1789121016.210920:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970678016 00000100:00100000:3.0:1789121016.210937:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789121016.210946:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970677888:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789121016.210978:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1789121016.211035:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970677888:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121016.211042:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1789121016.211060:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1789121016.211065:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970678016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789121016.211081:0:6523:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1789121016.211113:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970678016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121016.211130:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789121016.211253:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970678016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121016.211285:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c39a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970677888:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789121016.530462:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121016.976340:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121016.976389:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121016.976442:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121016.976566:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947555456 00000100:00100000:1.0:1789121016.976584:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947555456 00000100:00100000:1.0:1789121016.976668:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947555712 00000100:00100000:1.0:1789121016.976671:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947555712 00000100:00100000:1.0:1789121016.976695:0:6504:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947555584 00000100:00100000:1.0:1789121016.976698:0:6504:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947555584 00000100:00100000:1.0:1789121016.976732:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:1.0:1789121016.976742:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75b5d71e-0e31-479d-b240-b6a98d05b974+12:2409:x1876028947555456:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789121016.976758:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121016.976778:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887082e00/0xb74d2367a830f422 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8ff expref: 12 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121016.976795:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121016.976878:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:3.0:1789121016.976898:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75b5d71e-0e31-479d-b240-b6a98d05b974+11:2409:x1876028947555712:12345-192.168.202.32@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789121016.976909:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75b5d71e-0e31-479d-b240-b6a98d05b974+11:2409:x1876028947555456:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 166us (581us total) trans 0 rc 0/0 00010000:00010000:3.0:1789121016.976919:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789121016.976920:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00010000:00010000:3.0:1789121016.976949:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468a2f10200/0xb74d2367a830f67c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e9d8 expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121016.976958:0:6504:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:1.0:1789121016.976977:0:6504:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75b5d71e-0e31-479d-b240-b6a98d05b974+9:2409:x1876028947555584:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789121016.976979:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789121016.976993:0:6504:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121016.977009:0:6504:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887083200/0xb74d2367a830f429 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e930 expref: 9 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121016.977023:0:6504:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121016.977031:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:75b5d71e-0e31-479d-b240-b6a98d05b974+8:2409:x1876028947555712:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 139us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121016.977042:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:1.0:1789121016.977055:0:6504:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3a580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75b5d71e-0e31-479d-b240-b6a98d05b974+8:2409:x1876028947555584:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 80us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121016.977070:0:6504:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:0.0:1789121016.981423:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121016.983129:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947555968 00000100:00100000:2.0:1789121016.983145:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947555968 00000100:00080000:0.0:1789121016.983202:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789121016.983238:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 260 00000100:00100000:2.0:1789121016.983252:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+6:2408:x1876028947555968:12345-192.168.202.32@tcp:39:umount.0 00000020:00000080:2.0:1789121016.983295:0:6518:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f43e 00000020:00010000:2.0:1789121016.983305:0:6518:0:(genops.c:1921:obd_stale_export_put()) Put export ffff946783266800: total 0 00000100:00080000:2.0:1789121016.983310:0:6518:0:(import.c:65:import_set_state_nolock()) ffff946783264800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789121016.983338:0:6518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000020:00010000:3.0:1789121016.983362:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff946783266800: total 0 00010000:00010000:3.0:1789121016.983477:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff946783266800, canceled 0 locks, left on hash table 1. 00000100:00100000:2.0:1789121016.983542:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2408:x1876028947555968:12345-192.168.202.32@tcp:39:umount.0 Request processed in 292us (2130us total) trans 4294967528 rc 0/0 00000100:00100000:2.0:1789121016.983565:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 260 00010000:00010000:3.0:1789121016.984385:0:6507:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9468a3998700) 00010000:00010000:3.0:1789121016.984393:0:6507:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789121016.984407:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54c00/0xb74d2367a8310491 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edb3 expref: 4 pid: 6519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121016.984439:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff946783266800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789121016.984464:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121016.984467:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121016.984470:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121016.992223:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121016.993086:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947556096 00000100:00100000:1.0:1789121016.993104:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947556096 00000100:00080000:0.0:1789121016.993181:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789121016.993206:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 261 00000100:00100000:1.0:1789121016.993221:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+5:2408:x1876028947556096:12345-192.168.202.32@tcp:39:umount.0 00000020:00000080:1.0:1789121016.993271:0:11088:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f437 00000100:00080000:1.0:1789121016.993281:0:11088:0:(import.c:65:import_set_state_nolock()) ffff946783264000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789121016.993310:0:11088:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:3.0:1789121016.993350:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121016.993500:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec83c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:33ce8665-4f0b-4ca8-add3-a8f074595c87+3:2408:x1876028947556096:12345-192.168.202.32@tcp:39:umount.0 Request processed in 281us (1288us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789121016.993510:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 261 00000100:00100000:0.0:1789121017.055244:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121017.055427:0:6513:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947556352 00000100:00100000:3.0:1789121017.055441:0:6513:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947556352 00000100:00100000:3.0:1789121017.055589:0:6513:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 471 00000100:00100000:3.0:1789121017.055606:0:6513:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+7:2408:x1876028947556352:12345-192.168.202.32@tcp:251:umount.0 00000020:00000080:3.0:1789121017.055722:0:6513:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f2fc 00000020:00010000:3.0:1789121017.055733:0:6513:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9467839fb800: total 0 00000100:00080000:3.0:1789121017.055740:0:6513:0:(import.c:65:import_set_state_nolock()) ffff9467839fb000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789121017.055882:0:6513:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75b5d71e-0e31-479d-b240-b6a98d05b974+3:2408:x1876028947556352:12345-192.168.202.32@tcp:251:umount.0 Request processed in 282us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121017.055892:0:6513:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 471 00000020:00010000:0.0:1789121017.055978:0:8449:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9467839fb800: total 0 00010000:00010000:0.0:1789121017.055984:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121017.056060:0:8449:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9467839fb800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789121017.056107:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1400/0xb74d2367a830f3d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7e8f1 expref: 2 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121017.056130:0:8449:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9467839fb800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789121017.056153:0:8449:0:(genops.c:885:class_export_put()) final put ffff9467839fb800/75b5d71e-0e31-479d-b240-b6a98d05b974 00010000:00010000:0.0:1789121017.056176:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121017.056179:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121017.056181:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789121017.056236:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9467839fb800/75b5d71e-0e31-479d-b240-b6a98d05b974 for MGS 00000020:00000080:1.0:1789121017.056303:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9467839fb000 for MGS 00000040:00080000:0.0:1789121017.301004:0:14508:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789121017.303259:0:14508:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789121017.303669:0:14508:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789121017.303677:0:14508:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789121017.561225:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789121017.682643:0:14513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789121018.261044:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789121018.261076:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970678144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789121018.261176:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121018.261474:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970678144 00000100:00100000:3.0:1789121018.261483:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970678144 00000100:00100000:3.0:1789121018.261718:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789121018.261730:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970678144:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789121018.262966:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970678272:0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.263047:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121018.263088:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970678784:0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.263115:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121018.263138:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970679296:0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.263185:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121018.263216:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789121018.263223:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970678656:0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.263245:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121018.263265:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970679168:0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.263290:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121018.263307:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970679680:0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.263334:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121018.263371:0:6512:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970678272 00000100:00100000:2.0:1789121018.263379:0:6512:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970678272 00000100:00100000:2.0:1789121018.263429:0:6512:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00002000:00000024:3.0:1789121018.264180:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1789121018.264262:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970678144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2533us (3084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121018.264273:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789121018.264365:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970678784 00000100:00100000:3.0:1789121018.264370:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970678784 00000100:00100000:3.0:1789121018.264414:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789121018.264423:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970678784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.264546:0:6512:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970678272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.264592:0:6512:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689e3c4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970678272:12345-0@lo:400:kworker.0 Request processed in 1155us (1545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121018.264601:0:6512:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1789121018.264642:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970679296 00000100:00100000:2.0:1789121018.264647:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970679296 00000100:00100000:0.0:1789121018.264806:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789121018.264838:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970679808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121018.264879:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121018.264919:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970678400:0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.264948:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121018.265206:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970678784:12345-0@lo:400:kworker.0 Request processed in 784us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121018.265214:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789121018.265288:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970678272:0@lo:400:kworker.0 00000100:00100000:3.0:1789121018.265304:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970678784:0@lo:400:kworker.0 00000100:00100000:3.0:1789121018.265327:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970678144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121018.265573:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970678912:0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.265604:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121018.265653:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970678656 00000100:00100000:2.0:1789121018.265660:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970678656 00000100:00100000:2.0:1789121018.265706:0:6518:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970678400 00000100:00100000:2.0:1789121018.265709:0:6518:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970678400 00000100:00100000:2.0:1789121018.265728:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1789121018.265738:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970679296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.266055:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1876028970679296:12345-0@lo:400:kworker.0 Request processed in 319us (2868us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121018.266063:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00000100:00100000:2.0:1789121018.266080:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1789121018.266103:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970678656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.266136:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970678656:12345-0@lo:400:kworker.0 Request processed in 34us (2891us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121018.266142:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1789121018.266155:0:6518:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1789121018.266161:0:6518:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970678400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.266189:0:6518:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec9a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970678400:12345-0@lo:400:kworker.0 Request processed in 28us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121018.266195:0:6518:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1789121018.266218:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970679168 00000100:00100000:2.0:1789121018.266223:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970679168 00000100:00100000:2.0:1789121018.266255:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970679680 00000100:00100000:2.0:1789121018.266259:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970679680 00000100:00100000:2.0:1789121018.266283:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789121018.266290:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970679168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.266324:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970679168:12345-0@lo:400:kworker.0 Request processed in 35us (3034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121018.266331:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789121018.266343:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789121018.266349:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970679680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.266380:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970679680:12345-0@lo:400:kworker.0 Request processed in 32us (3045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121018.266386:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789121018.266632:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970679424:0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.266666:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121018.266727:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970678400:0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.266745:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1789121018.266753:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970678528:0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.266931:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121018.266954:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970679040:0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.266975:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121018.266986:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970679552:0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.267007:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789121018.267053:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789121018.267059:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789121018.267062:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121018.267076:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970679808 00000100:00100000:0.0:1789121018.267081:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970679808 00000100:00100000:0.0:1789121018.267112:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789121018.267118:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783eca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970679808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789121018.267137:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789121018.267176:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783eca580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970679808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (2296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121018.267183:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789121018.268575:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970678528 00000100:00100000:0.0:1789121018.268586:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970678528 00000100:00100000:0.0:1789121018.268649:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789121018.268659:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970678528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.268834:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec8780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970678528:12345-0@lo:400:kworker.0 Request processed in 162us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121018.268843:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789121018.268981:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970678912 00000100:00100000:0.0:1789121018.268985:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970678912 00000100:00100000:0.0:1789121018.269022:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970679424 00000100:00100000:0.0:1789121018.269026:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970679424 00000100:00100000:0.0:1789121018.269040:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970679040 00000100:00100000:0.0:1789121018.269043:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970679040 00000100:00100000:0.0:1789121018.269057:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1789121018.269064:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970678912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.269100:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970678912:12345-0@lo:400:kworker.0 Request processed in 37us (3496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121018.269107:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1789121018.269129:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1789121018.269135:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970679424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.269169:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecbc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1876028970679424:12345-0@lo:400:kworker.0 Request processed in 34us (2503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121018.269175:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:0.0:1789121018.269187:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:0.0:1789121018.269192:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ecb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970679040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.269222:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ecb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970679040:12345-0@lo:400:kworker.0 Request processed in 30us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121018.269227:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00080000:0.0:1789121018.269246:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789121018.269250:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789121018.269307:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970679808:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121018.269347:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970679552 00000100:00100000:0.0:1789121018.269351:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970679552 00000100:00100000:0.0:1789121018.269381:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789121018.269389:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783ec9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970679552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.269424:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783ec9680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970679552:12345-0@lo:400:kworker.0 Request processed in 36us (2416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121018.269430:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789121018.269956:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789121018.269973:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970679936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789121018.270022:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121018.270059:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970679936 00000100:00100000:1.0:1789121018.270063:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970679936 00000100:00100000:1.0:1789121018.270092:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789121018.270098:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970679936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789121018.270122:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789121018.270157:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970679936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121018.270164:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789121018.270197:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970679936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789121018.271104:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970678656:0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.271123:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970679168:0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.271160:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970679680:0@lo:400:kworker.0 00000100:00100000:2.0:1789121018.271173:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3647:1876028970679296:0@lo:400:kworker.0 00000100:00080000:0.0:1789121018.274628:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789121018.274730:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970678528:0@lo:400:kworker.0 00010000:00080000:0.0:1789121018.274754:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99c61c0 x1876028970679040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121018.274767:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970679040:0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.274796:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970679552:0@lo:400:kworker.0 00000100:00100000:0.0:1789121018.274811:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970678912:0@lo:400:kworker.0 00010000:00080000:0.0:1789121018.274842:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99c5e00 x1876028970679424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121018.274852:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970679424:0@lo:400:kworker.0 00010000:00010000:3.0:1789121018.577978:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121018.779304:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970680064:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789121018.779402:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121018.779513:0:8437:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970680064 00000100:00100000:0.0:1789121018.779525:0:8437:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970680064 00000100:00100000:0.0:1789121018.779610:0:8437:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789121018.779622:0:8437:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970680064:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789121018.779653:0:8437:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789121018.783126:0:8437:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970680064:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3489us (3709us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121018.783146:0:8437:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1789121018.783334:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970680064:0@lo:13:osp-pre-1-1.0 00000020:01000004:0.0:1789121019.270319:0:15865:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789121019.305994:0:15865:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789121019.306092:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.306111:0:15865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.306121:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.306129:0:15865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.306181:0:15865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789121019.306189:0:15865:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789121019.306224:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789121019.306231:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789121019.306240:0:15865:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789121019.306278:0:15865:0:(import.c:65:import_set_state_nolock()) ffff9468a0882800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789121019.306418:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ecb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970680192:0@lo:39:umount.0 00000100:00100000:2.0:1789121019.306522:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121019.306721:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970680192 00000100:00100000:0.0:1789121019.306730:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970680192 00000100:00100000:0.0:1789121019.306802:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789121019.306813:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876028970680192:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789121019.306880:0:6520:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ef1a 00000100:00080000:0.0:1789121019.306893:0:6520:0:(import.c:65:import_set_state_nolock()) ffff9468afd50000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1789121019.306970:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3643:x1876028970680192:12345-0@lo:39:umount.0 Request processed in 157us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121019.306979:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1789121019.306992:0:6520:0:(genops.c:885:class_export_put()) final put ffff9468afd54000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789121019.307303:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121019.307314:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.307324:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121019.307328:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.307338:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121019.307367:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121019.307373:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121019.307376:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789121019.307378:0:8449:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789121019.307419:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.307426:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121019.307520:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.307538:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a2e00/0xb74d2367a830f3a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f3ab expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.307556:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121019.307558:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121019.307560:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789121019.307573:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afd54000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789121019.307645:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468afd50000 for lustre-MDT0000 00000100:00100000:0.0:1789121019.307664:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970680320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121019.307720:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789121019.307849:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a0882800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789121019.307863:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ecb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970680192:0@lo:39:umount.0 00000100:00080000:0.0:1789121019.307894:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789121019.307897:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789121019.307902:0:15865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789121019.308175:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121019.308906:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970680320 00000100:00100000:2.0:1789121019.308919:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970680320 00000100:00100000:2.0:1789121019.308997:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789121019.309023:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+24:3646:x1876028970680320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121019.309044:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121019.309068:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a2400/0xb74d2367a830f3ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f3a4 expref: 24 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121019.309088:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121019.309170:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835e9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+23:3646:x1876028970680320:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121019.309179:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789121019.309427:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970680320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789121019.311787:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.311812:0:15865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.320953:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.320979:0:15865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321022:0:15865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121019.321036:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321044:0:15865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321050:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321056:0:15865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321067:0:15865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789121019.321074:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321082:0:15865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321107:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321113:0:15865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321126:0:15865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789121019.321140:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789121019.321148:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321156:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121019.321160:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321171:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121019.321179:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121019.321186:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121019.321189:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789121019.321250:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321257:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121019.321287:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321306:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a830f3b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f3b9 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321324:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121019.321328:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321334:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887082a00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121019.321337:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321344:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121019.321352:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121019.321357:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121019.321360:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789121019.321363:0:8449:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789121019.321381:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321387:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121019.321406:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321413:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887082a00/0xb74d2367a830f2b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f2bd expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321634:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121019.321639:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321645:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2200 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121019.321648:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321654:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121019.321661:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121019.321666:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789121019.321668:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789121019.321670:0:8449:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789121019.321685:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321692:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121019.321699:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321705:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a2200/0xb74d2367a830f6ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f6b4 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.321716:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121019.321718:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121019.321726:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121019.321753:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ecb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970680448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121019.321884:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121019.321964:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970680576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121019.321992:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121019.322025:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121019.322032:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970680704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121019.322055:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121019.322092:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970680448 00000100:00100000:0.0:1789121019.322100:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970680448 00000100:00100000:0.0:1789121019.322161:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970680576 00000100:00100000:0.0:1789121019.322166:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970680576 00000100:00100000:0.0:1789121019.322189:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970680704 00000100:00100000:0.0:1789121019.322192:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970680704 00000100:00100000:0.0:1789121019.322214:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789121019.322226:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+25:3647:x1876028970680448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789121019.322245:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121019.322262:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1000/0xb74d2367a830f3b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f3b2 expref: 25 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.322276:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121019.322315:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+24:3647:x1876028970680448:12345-0@lo:103:ldlm_bl.0 Request processed in 91us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121019.322323:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789121019.322344:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789121019.322350:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+23:3644:x1876028970680576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789121019.322357:0:6503:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121019.322365:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887082000/0xb74d2367a830f2bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f2b6 expref: 23 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.322383:0:6503:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121019.322410:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:03a1864a-46e4-4762-8a00-3ced97b06903+22:3644:x1876028970680576:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121019.322417:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1789121019.323511:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121019.323612:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789121019.323633:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+21:3644:x1876028970680704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121019.323648:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121019.323668:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0e00/0xb74d2367a830f6b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f6ad expref: 21 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121019.323683:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121019.323741:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+20:3644:x1876028970680704:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (1684us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121019.323749:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1789121019.324388:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121019.325674:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ecb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970680448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121019.325724:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783eca1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970680704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121019.325736:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783ec9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:03a1864a-46e4-4762-8a00-3ced97b06903:3644:1876028970680576:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789121019.325773:0:15865:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f11c00/0xb74d2367a830ee72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.325785:0:15865:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f11c00/0xb74d2367a830ee72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.325793:0:15865:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f11c00/0xb74d2367a830ee72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.325801:0:15865:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468a2f11c00/0xb74d2367a830ee72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.325850:0:15865:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789121019.325858:0:15865:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1789121019.325863:0:15865:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1789121019.325916:0:15865:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1789121019.325921:0:15865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1789121019.325927:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121019.325934:0:15865:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1789121019.325940:0:15865:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9468b9c33800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789121019.325965:0:15865:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9467821db000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789121019.325970:0:15865:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff94689e114000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789121019.325975:0:15865:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9468c191f000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:0.0:1789121019.325983:0:15865:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff946783266800 33ce8665-4f0b-4ca8-add3-a8f074595c87 192.168.202.32@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789121019.325988:0:15865:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff946783061800 3dde8702-0a22-4cb8-87f3-66b167299fdd 192.168.202.32@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967522 stale:0 00000020:00080000:0.0:1789121019.325994:0:15865:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9468ab904ed8) has exports, disconnecting them 00000020:00080000:0.0:1789121019.325999:0:15865:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9468b9c33800), last request at 1789121018 00000020:00000080:0.0:1789121019.327770:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f223 00000100:00080000:0.0:1789121019.327802:0:15865:0:(import.c:65:import_set_state_nolock()) ffff9468b9c33000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789121019.327890:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121019.327900:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468a2f11c00/0xb74d2367a830ee72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.327913:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f11c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121019.327918:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f11c00/0xb74d2367a830ee72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.327930:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468a2f11c00/0xb74d2367a830ee72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121019.327939:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f11c00/0xb74d2367a830ee72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121019.327945:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789121019.327949:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789121019.327951:0:8449:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789121019.327998:0:8449:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468a2f11c00/0xb74d2367a830ee72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.328033:0:8449:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121019.328060:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468a2f11c00/0xb74d2367a830ee72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.328068:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468a2f11c00/0xb74d2367a830ee72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830ee79 expref: -99 pid: 6495 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121019.328082:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121019.328084:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121019.328086:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121019.328095:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789121019.328120:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970680832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121019.328205:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:0.0:1789121019.328275:0:15865:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468b9c33800): rc 0 00000020:00000080:0.0:1789121019.328278:0:15865:0:(genops.c:885:class_export_put()) final put ffff9468b9c33800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1789121019.328291:0:15865:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9467821db000), last request at 1789121018 00000020:00000080:0.0:1789121019.328297:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f0fd 00000100:00080000:0.0:1789121019.328303:0:15865:0:(import.c:65:import_set_state_nolock()) ffff9467821dc800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789121019.328313:0:15865:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9467821db000): rc 0 00000020:00000080:0.0:1789121019.328315:0:15865:0:(genops.c:885:class_export_put()) final put ffff9467821db000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1789121019.328319:0:15865:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff94689e114000), last request at 1789120755 00000020:00000080:0.0:1789121019.328321:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830effa 00000100:00080000:0.0:1789121019.328325:0:15865:0:(import.c:65:import_set_state_nolock()) ffff94689e116000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789121019.328334:0:15865:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94689e114000): rc 0 00000020:00000080:0.0:1789121019.328336:0:15865:0:(genops.c:885:class_export_put()) final put ffff94689e114000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1789121019.328340:0:15865:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9468c191f000), last request at 1789120755 00000020:00000080:0.0:1789121019.328343:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830efbb 00000100:00080000:0.0:1789121019.328354:0:15865:0:(import.c:65:import_set_state_nolock()) ffff9468c081b800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1789121019.328364:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789121019.328371:0:15865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:3.0:1789121019.329188:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121019.329198:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121019.329227:0:10341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970680832 00000100:00100000:3.0:1789121019.329238:0:10341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970680832 00000100:00100000:3.0:1789121019.329314:0:10341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789121019.329325:0:10341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+20:3647:x1876028970680832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121019.329344:0:10341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121019.329364:0:10341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887083c00/0xb74d2367a830ee79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830ee72 expref: 20 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121019.329380:0:10341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121019.330209:0:10341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e9680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:03a1864a-46e4-4762-8a00-3ced97b06903+19:3647:x1876028970680832:12345-0@lo:103:ldlm_bl.0 Request processed in 878us (1996us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121019.330223:0:10341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789121019.330321:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:03a1864a-46e4-4762-8a00-3ced97b06903:3647:1876028970680832:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1789121019.331352:0:15865:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468c191f000): rc 0 00000004:00000080:0.0:1789121019.331365:0:15865:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa04ac1817ae0 00000100:00080000:0.0:1789121019.331393:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789121019.331399:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1789121019.333419:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789121019.333855:0:15865:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789121019.333897:0:15865:0:(import.c:65:import_set_state_nolock()) ffff9468b98a7800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1789121019.334303:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970680960:0@lo:39:umount.0 00000100:00100000:2.0:1789121019.334410:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121019.334746:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970680960 00000100:00100000:3.0:1789121019.334756:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970680960 00000100:00100000:3.0:1789121019.334814:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1789121019.334843:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3643:x1876028970680960:12345-0@lo:39:umount.0 00000020:00000080:3.0:1789121019.334886:0:12532:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f055 00000100:00080000:3.0:1789121019.334897:0:12532:0:(import.c:65:import_set_state_nolock()) ffff9468b9996000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789121019.334929:0:12532:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789121019.335139:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3643:x1876028970680960:12345-0@lo:39:umount.0 Request processed in 298us (728us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789121019.335148:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00010000:00010000:3.0:1789121019.335175:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789121019.335211:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468b98a7800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789121019.335219:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970680960:0@lo:39:umount.0 00000100:00080000:0.0:1789121019.336102:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789121019.336109:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1789121019.336123:0:15865:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789121019.336184:0:15865:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789121019.336210:0:15865:0:(import.c:65:import_set_state_nolock()) ffff94689e051800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789121019.336233:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789121019.336235:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:0.0:1789121019.336250:0:15865:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789121019.336313:0:15865:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789121019.336323:0:15865:0:(import.c:65:import_set_state_nolock()) ffff946783ca8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789121019.336357:0:15865:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9468ab904ed8) has no exports 00000100:00100000:3.0:1789121019.336801:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970681088:0@lo:9:umount.0 00000100:00100000:3.0:1789121019.336895:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121019.336934:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970681216:0@lo:9:umount.0 00000100:00100000:3.0:1789121019.336960:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121019.337019:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970681088 00000100:00100000:3.0:1789121019.337026:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970681088 00000100:00100000:3.0:1789121019.337073:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970681216 00000100:00100000:3.0:1789121019.337076:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970681216 00000100:00100000:3.0:1789121019.337102:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789121019.337113:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876028970681088:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789121019.337143:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f1a5 00000100:00080000:3.0:1789121019.337153:0:8434:0:(import.c:65:import_set_state_nolock()) ffff9468bf682000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789121019.337209:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789121019.337377:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3643:x1876028970681088:12345-0@lo:9:umount.0 Request processed in 265us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121019.337386:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789121019.337406:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789121019.337413:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3643:x1876028970681216:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789121019.337426:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f2e7 00000100:00080000:3.0:1789121019.337755:0:8434:0:(import.c:65:import_set_state_nolock()) ffff946783cab000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789121019.337856:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789121019.337951:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3643:x1876028970681216:12345-0@lo:9:umount.0 Request processed in 538us (989us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121019.337959:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000020:00000080:1.0:1789121019.338030:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468b9c33800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789121019.338087:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9467821db000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1789121019.338112:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94689e114000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1789121019.338138:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468b9c33000 for lustre-MDT0000 00000020:00000080:1.0:1789121019.338143:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9467821dc800 for lustre-MDT0000 00000020:00000080:1.0:1789121019.338147:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94689e116000 for lustre-MDT0000 00010000:00010000:2.0:1789121019.338581:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121019.338710:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789121019.338764:0:3643:0:(import.c:65:import_set_state_nolock()) ffff94689e051800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789121019.338785:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789121019.338788:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789121019.338793:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970681088:0@lo:9:umount.0 00000100:00080000:3.0:1789121019.338809:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783ca8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789121019.338844:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789121019.338846:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789121019.338849:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970681216:0@lo:9:umount.0 00000020:00080000:0.0:1789121019.343395:0:15865:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9468ab904ed8) has no exports 00000020:00000080:0.0:1789121019.416452:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830eecd 00000020:00000080:0.0:1789121019.416470:0:15865:0:(genops.c:885:class_export_put()) final put ffff9468afc25000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789121019.416705:0:15865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789121019.416870:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121019.416950:0:15865:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789121019.416957:0:15865:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff94688415b490) has no exports 00000020:00000080:1.0:1789121019.417308:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afc25000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789121019.419279:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830eec6 00000020:00000080:2.0:1789121019.419297:0:15865:0:(genops.c:885:class_export_put()) final put ffff9468afc22800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789121019.419540:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afc22800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789121019.419695:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121019.419735:0:15865:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789121019.419740:0:15865:0:(genops.c:885:class_export_put()) final put ffff94688414d000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789121019.419803:0:15865:0:(genops.c:844:class_export_destroy()) destroying export ffff94688414d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789121019.419858:0:15865:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1789121019.602199:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121020.626892:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789121020.825481:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789121020.825493:0:6497:0:(genops.c:885:class_export_put()) final put ffff9468c191f000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:0.0:1789121020.825531:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 33ce8665-4f0b-4ca8-add3-a8f074595c87 00000001:00080000:0.0:1789121020.825541:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:0.0:1789121020.825546:0:6497:0:(genops.c:885:class_export_put()) final put ffff946783266800/33ce8665-4f0b-4ca8-add3-a8f074595c87 00000001:00100000:0.0:1789121020.825572:0:6497:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000001:00080000:0.0:1789121020.825577:0:6497:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:0.0:1789121020.825596:0:6497:0:(genops.c:885:class_export_put()) final put ffff946783061800/3dde8702-0a22-4cb8-87f3-66b167299fdd 00000020:00000080:1.0:1789121020.828640:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c191f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1789121020.828740:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff946783266800/33ce8665-4f0b-4ca8-add3-a8f074595c87 for lustre-MDT0000 00000020:00000080:1.0:1789121020.828774:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff946783061800/3dde8702-0a22-4cb8-87f3-66b167299fdd for lustre-MDT0000 00000020:00000080:1.0:1789121020.828810:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468c081b800 for lustre-MDT0000 00000020:00000080:1.0:1789121020.828817:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783264800 for lustre-MDT0000 00000020:00000080:1.0:1789121020.828841:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783061000 for lustre-MDT0000 00000001:00100000:2.0:1789121020.830013:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789121020.830026:0:9516:0:(genops.c:885:class_export_put()) final put ffff946783cab800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1789121020.830064:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000020:00000080:2.0:1789121020.830067:0:9516:0:(genops.c:885:class_export_put()) final put ffff9468853fb000/3dde8702-0a22-4cb8-87f3-66b167299fdd 00000001:00100000:1.0:1789121020.830438:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789121020.830443:0:8428:0:(genops.c:885:class_export_put()) final put ffff9468bf680000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1789121020.830455:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000020:00000080:1.0:1789121020.830457:0:8428:0:(genops.c:885:class_export_put()) final put ffff9467849b3000/3dde8702-0a22-4cb8-87f3-66b167299fdd 00000001:00100000:0.0:1789121020.830899:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1789121020.830913:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:0.0:1789121020.830919:0:7450:0:(genops.c:885:class_export_put()) final put ffff9468b9990000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1789121020.830926:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 33ce8665-4f0b-4ca8-add3-a8f074595c87 00000001:00080000:0.0:1789121020.830931:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:0.0:1789121020.830933:0:7450:0:(genops.c:885:class_export_put()) final put ffff946783261000/33ce8665-4f0b-4ca8-add3-a8f074595c87 00000001:00100000:0.0:1789121020.830938:0:7450:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 3dde8702-0a22-4cb8-87f3-66b167299fdd 00000001:00080000:0.0:1789121020.830941:0:7450:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:0.0:1789121020.830943:0:7450:0:(genops.c:885:class_export_put()) final put ffff9468bf6a8800/3dde8702-0a22-4cb8-87f3-66b167299fdd 00000020:00000080:3.0:1789121020.832069:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946783cab800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789121020.832168:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468853fb000/3dde8702-0a22-4cb8-87f3-66b167299fdd for lustre-OST0001 00000020:00000080:3.0:1789121020.832190:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468bf680000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789121020.832211:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9467849b3000/3dde8702-0a22-4cb8-87f3-66b167299fdd for lustre-OST0000 00000020:00000080:3.0:1789121020.832232:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468b9990000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789121020.832288:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946783261000/33ce8665-4f0b-4ca8-add3-a8f074595c87 for lustre-MDT0001 00000020:00000080:3.0:1789121020.832347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468bf6a8800/3dde8702-0a22-4cb8-87f3-66b167299fdd for lustre-MDT0001 00000020:00000080:3.0:1789121020.832376:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783cab000 for lustre-OST0001 00000020:00000080:3.0:1789121020.832380:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468853f9800 for lustre-OST0001 00000020:00000080:3.0:1789121020.832384:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468bf682000 for lustre-OST0000 00000020:00000080:3.0:1789121020.832389:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9467849b6800 for lustre-OST0000 00000020:00000080:3.0:1789121020.832392:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468b9996000 for lustre-MDT0001 00000020:00000080:3.0:1789121020.832396:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783264000 for lustre-MDT0001 00000020:00000080:3.0:1789121020.832400:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468bf6ae000 for lustre-MDT0001 00000100:00100000:1.0:1789121021.331585:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970681344:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789121021.331704:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121021.332200:0:6523:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970681344 00000100:00100000:0.0:1789121021.332214:0:6523:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970681344 00000100:00100000:0.0:1789121021.332273:0:6523:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1789121021.332284:0:6523:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1876028970681344:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1789121021.332296:0:6523:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789121021.332363:0:6523:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3647:x1876028970681344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 78us (659us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789121021.332371:0:6523:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:02020000:1.0:1789121021.333786:0:3647:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00080000:1.0:1789121021.341116:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789121021.341125:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9468c191c000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789121021.341130:0:3647:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789121021.362908:0:3647:0:(import.c:65:import_set_state_nolock()) ffff9468c191c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121021.362931:0:3647:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 205 00000100:00080000:1.0:1789121021.362943:0:3647:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9468c191c000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121021.363031:0:3647:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9467848fad00 x1876028970681472/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789121021.364749:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970681472:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789121021.364895:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121021.365312:0:6524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970681472 00000100:00100000:2.0:1789121021.365322:0:6524:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970681472 00000100:00100000:2.0:1789121021.365363:0:6524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1789121021.365371:0:6524:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970681472:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1789121021.365390:0:6524:0:(ldlm_lib.c:1241:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1789121021.367502:0:6524:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970681472:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 2123us (2601us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789121021.367526:0:6524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00080000:1.0:1789121021.377921:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468c191c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121021.377937:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789121021.377943:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848fad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970681472:0@lo:38:ptlrpcd_00_03.0 00000020:01000000:2.0:1789121021.458051:0:15865:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946783ba9a20 - data ffff9468ab19cd80/ffff946783b71400 00000020:01000000:2.0:1789121021.458221:0:15865:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9468afd10ba0 - data ffff9468ab1535e8/ffff9468afde1800 00000001:00000004:2.0:1789121021.465580:0:15865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1789121021.523007:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789121021.523016:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:2.0:1789121021.523171:0:15865:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9468938e83c0 x1876028970680960/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789121029 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121021.523203:0:15865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789121021.528928:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789121021.528936:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1789121021.528948:0:15865:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121021.528950:0:15865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789121021.529469:0:8912:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789121021.529475:0:8912:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789121021.529486:0:8912:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789121021.532302:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789121021.532312:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:2.0:1789121021.532334:0:15865:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121021.532337:0:15865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789121021.532921:0:9818:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789121021.532926:0:9818:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1789121021.532936:0:9818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789121021.537359:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ee95 00000020:00000080:2.0:1789121021.537385:0:15865:0:(genops.c:885:class_export_put()) final put ffff946884149800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789121021.539166:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff946884149800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789121021.542190:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830eeaa 00000020:00000080:2.0:1789121021.542204:0:15865:0:(genops.c:885:class_export_put()) final put ffff94688414f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789121021.542225:0:15865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1789121021.542231:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121021.542240:0:15865:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789121021.542244:0:15865:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9468ab903490) has no exports 00000004:01000000:2.0:1789121021.542418:0:15865:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789121021.542427:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f2e0 00000020:00000080:2.0:1789121021.542432:0:15865:0:(genops.c:885:class_export_put()) final put ffff946783ca8800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789121021.542436:0:15865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789121021.542439:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121021.542448:0:15865:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789121021.542450:0:15865:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff946783ca0000) has no exports 00000020:00000080:2.0:1789121021.542456:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f2d9 00000020:00000080:2.0:1789121021.542460:0:15865:0:(genops.c:885:class_export_put()) final put ffff946783ca9800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789121021.542816:0:15865:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789121021.543027:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789121021.543031:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:2.0:1789121021.543037:0:15865:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121021.543039:0:15865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789121021.543071:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121021.543080:0:15865:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789121021.543087:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f19e 00000020:00000080:2.0:1789121021.543093:0:15865:0:(genops.c:885:class_export_put()) final put ffff9468bf6ac000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789121021.543097:0:15865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789121021.543101:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121021.543115:0:15865:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789121021.543118:0:15865:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9468afc7b490) has no exports 00000020:00000080:2.0:1789121021.543122:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f197 00000020:00000080:2.0:1789121021.543126:0:15865:0:(genops.c:885:class_export_put()) final put ffff94689e050000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1789121021.543494:0:15865:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1789121021.543497:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789121021.543499:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1789121021.543515:0:15865:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789121021.543516:0:15865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789121021.543545:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121021.543550:0:15865:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1789121021.543561:0:15865:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789121021.543566:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f04e 00000020:00000080:2.0:1789121021.543571:0:15865:0:(genops.c:885:class_export_put()) final put ffff9468c191c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1789121021.543575:0:15865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1789121021.543579:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121021.543583:0:15865:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789121021.543585:0:15865:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff946884158000) has no exports 00000020:00000080:2.0:1789121021.543588:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f047 00000020:00000080:2.0:1789121021.543591:0:15865:0:(genops.c:885:class_export_put()) final put ffff9468b98a5800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789121021.544286:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94688414f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1789121021.544301:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff946783ca8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789121021.544307:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff946783ca9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789121021.544312:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783ca8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1789121021.544320:0:36:0:(genops.c:885:class_export_put()) final put ffff946783262000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789121021.544322:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff946783262000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1789121021.544325:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789121021.544415:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9468bf6ac000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789121021.544421:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94689e050000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789121021.544425:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94689e051800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1789121021.544431:0:36:0:(genops.c:885:class_export_put()) final put ffff9468afe5f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789121021.544432:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afe5f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1789121021.544435:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789121021.544464:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c191c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1789121021.544470:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9468b98a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1789121021.595872:0:15865:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1789121021.595881:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789121021.595886:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1789121021.595906:0:15865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789121021.595970:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121021.595985:0:15865:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789121021.596960:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121021.596967:0:15865:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789121021.596972:0:15865:0:(genops.c:885:class_export_put()) final put ffff94689e113800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789121021.596976:0:15865:0:(genops.c:844:class_export_destroy()) destroying export ffff94689e113800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789121021.596987:0:15865:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789121021.597088:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830eeb1 00000020:00000080:2.0:1789121021.597103:0:15865:0:(genops.c:885:class_export_put()) final put ffff94688414b000/lustre-MDD0000_UUID 00000020:01000000:2.0:1789121021.597108:0:15865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1789121021.597110:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121021.597114:0:15865:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789121021.597117:0:15865:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff946884159a48) has no exports 00000020:00000080:2.0:1789121021.597134:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121021.597136:0:15865:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1789121021.597139:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830eeb8 00000020:00000080:2.0:1789121021.597141:0:15865:0:(genops.c:885:class_export_put()) final put ffff94688414b800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1789121021.597148:0:15865:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946886899000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1789121021.597150:0:15865:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946886899000 3 00000020:01000004:2.0:1789121021.597152:0:15865:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946886899000 from lustre-MDT0000 00000020:00000080:2.0:1789121021.597164:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121021.597166:0:15865:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1789121021.597167:0:15865:0:(genops.c:885:class_export_put()) final put ffff946884149000/lustre-MDT0000_UUID 00000020:00000080:2.0:1789121021.597169:0:15865:0:(genops.c:844:class_export_destroy()) destroying export ffff946884149000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1789121021.597174:0:15865:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1789121021.597195:0:15865:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1789121021.597198:0:15865:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1789121021.597200:0:15865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1789121021.597202:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121021.597203:0:15865:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789121021.597208:0:15865:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff94689138f000 03a1864a-46e4-4762-8a00-3ced97b06903 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789121021.597213:0:15865:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff946882bf1a48) has exports, disconnecting them 00000020:00080000:2.0:1789121021.597217:0:15865:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff94689138f000), last request at 1789120730 00000020:00000080:2.0:1789121021.597232:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ee56 00000020:00010000:2.0:1789121021.597236:0:15865:0:(genops.c:1921:obd_stale_export_put()) Put export ffff94689138f000: total 2 00000100:00080000:2.0:1789121021.597240:0:15865:0:(import.c:65:import_set_state_nolock()) ffff94689138c800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789121021.597263:0:15865:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff94689138f000): rc 0 00000020:00080000:2.0:1789121021.597267:0:15865:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff946882bf1a48) has no exports 00000100:00100000:2.0:1789121021.597332:0:6512:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff946885597000:6512] 1 exiting: rc = 0 00000100:00100000:2.0:1789121021.597425:0:6510:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9468a0416200:6510] 0 exiting: rc = 1 00000100:00100000:2.0:1789121021.598437:0:6513:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff946885596800:6513] 2 exiting: rc = 0 00000100:00100000:2.0:1789121021.598543:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598553:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598559:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598565:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598570:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598576:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598581:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598588:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598609:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598618:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:0.0:1789121021.598619:0:6507:0:(genops.c:1907:obd_stale_export_get()) Get export ffff94689138f000: total 2 00000100:00100000:2.0:1789121021.598627:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598633:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598642:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.598693:0:6507:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff94689138f000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1789121021.598733:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0800/0xb74d2367a830f38f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f388 expref: 14 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.598736:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598751:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.598758:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3800/0xb74d2367a830f39d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f396 expref: 13 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.598763:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598772:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.598783:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e23000/0xb74d2367a830f68a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f683 expref: 12 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.598784:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598795:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.598802:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946880031e00/0xb74d2367a830ef52 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830ef4b expref: 11 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.598812:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598844:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.598851:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468a2f11400/0xb74d2367a830f6a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f69f expref: 10 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.598859:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598871:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.598875:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468a2f10000/0xb74d2367a830f698 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f691 expref: 9 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.598885:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.598900:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946880030200/0xb74d2367a830ef60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830ef59 expref: 8 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.598909:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.598922:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a54200/0xb74d2367a830f277 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f270 expref: 7 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.598923:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598933:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598943:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.598944:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0a00/0xb74d2367a830f3c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f3c0 expref: 6 pid: 6512 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.598955:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.598964:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1a00/0xb74d2367a830f357 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f350 expref: 5 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.598967:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598978:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.598986:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d1c00/0xb74d2367a830f365 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f35e expref: 4 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.598988:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.598999:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599009:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.599018:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9467838d0200/0xb74d2367a830f373 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f36c expref: 3 pid: 6510 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121021.599028:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.599034:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946887082400/0xb74d2367a830f381 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xb74d2367a830f37a expref: 2 pid: 6513 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121021.599049:0:6507:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff94689138f000, canceled 13 locks, left on hash table 0. 00000100:00100000:2.0:1789121021.599050:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599060:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599072:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789121021.599074:0:6507:0:(genops.c:885:class_export_put()) final put ffff94689138f000/03a1864a-46e4-4762-8a00-3ced97b06903 00000100:00100000:2.0:1789121021.599081:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599089:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.599090:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121021.599094:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121021.599098:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:0.0:1789121021.599099:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121021.599108:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599115:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599121:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599127:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599133:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599138:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599144:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599150:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599157:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599164:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599171:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599177:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599184:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789121021.599184:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468b98a7800 for lustre-MDT0001-osp-MDT0000 00000100:00100000:2.0:1789121021.599193:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789121021.599197:0:36:0:(genops.c:885:class_export_put()) final put ffff9468c191e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789121021.599203:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c191e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000100:00100000:2.0:1789121021.599204:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599214:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1789121021.599222:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000100:00100000:2.0:1789121021.599223:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599230:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599236:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599243:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599248:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599253:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789121021.599258:0:15865:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789121021.599298:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94688414b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1789121021.599304:0:36:0:(genops.c:885:class_export_put()) final put ffff94688414c000/lustre-MDD0000_UUID 00000020:00000080:1.0:1789121021.599306:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94688414c000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1789121021.599312:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1789121021.599360:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94688414b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789121021.599365:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff94689138f000/03a1864a-46e4-4762-8a00-3ced97b06903 for MGS 00000020:00000080:1.0:1789121021.599419:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94689138c800 for MGS 00000020:01000000:1.0:1789121021.602272:0:15865:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9467839f71e0 - data ffff9468ab31f000/ffff9468b9d93800 00000020:01000000:1.0:1789121021.602439:0:15865:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff94688681d0c0 - data ffff9468ab096510/ffff946887bc4c00 00000020:00000080:1.0:1789121021.603322:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ee3a 00000020:00000080:1.0:1789121021.603331:0:15865:0:(genops.c:885:class_export_put()) final put ffff9468a2d3e800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789121021.603418:0:15865:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946886899000 from MGS, refs=2 00000020:01000004:1.0:1789121021.603422:0:15865:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946886899000 2 00000020:01000004:1.0:1789121021.603426:0:15865:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946886899000 from MGS 00000020:00000080:1.0:1789121021.603448:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789121021.603455:0:15865:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789121021.603458:0:15865:0:(genops.c:885:class_export_put()) final put ffff946890538800/MGS 00000020:00000080:1.0:1789121021.603462:0:15865:0:(genops.c:844:class_export_destroy()) destroying export ffff946890538800/MGS for MGS 00000020:01000000:1.0:1789121021.603471:0:15865:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789121021.603564:0:15865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789121021.603568:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789121021.603575:0:15865:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789121021.603585:0:15865:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9468a0880000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789121021.603591:0:15865:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9468afc78000) has exports, disconnecting them 00000020:00080000:1.0:1789121021.603607:0:15865:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9468a0880000), last request at 1789120731 00000020:00000080:1.0:1789121021.603624:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ef05 00000020:00080000:1.0:1789121021.603635:0:15865:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468a0880000): rc 0 00000020:00000080:1.0:1789121021.603640:0:15865:0:(genops.c:885:class_export_put()) final put ffff9468a0880000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789121021.605586:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a2d3e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789121021.612245:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a0880000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789121021.612911:0:15865:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789121021.613033:0:15865:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789121021.613109:0:15865:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789121021.613117:0:15865:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789121021.613184:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468a0882800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789121021.613399:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121021.613409:0:15865:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1789121021.613414:0:15865:0:(genops.c:885:class_export_put()) final put ffff94689df26000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1789121021.613418:0:15865:0:(genops.c:844:class_export_destroy()) destroying export ffff94689df26000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1789121021.613426:0:15865:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789121021.613527:0:15865:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946886899000 1 00000020:00000080:0.0:1789121021.613533:0:15865:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ee2c 00000020:00000080:0.0:1789121021.613539:0:15865:0:(genops.c:885:class_export_put()) final put ffff94689053d000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789121021.613556:0:15865:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789121021.613561:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121021.613566:0:15865:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789121021.613579:0:15865:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff946882bf0000) has no exports 00000020:00000080:2.0:1789121021.614078:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff94689053d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789121021.720331:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789121021.737656:0:15865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789121021.737669:0:15865:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789121021.737675:0:15865:0:(genops.c:885:class_export_put()) final put ffff9468a2d3d000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789121021.737680:0:15865:0:(genops.c:844:class_export_destroy()) destroying export ffff9468a2d3d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789121021.737690:0:15865:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789121021.737837:0:15865:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94688689f000 00000020:02000400:1.0:1789121021.737900:0:15865:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789121022.748284:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789121023.377978:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789121023.377985:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789121023.377989:0:36:0:(import.c:65:import_set_state_nolock()) ffff9468c191c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121023.377996:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 471 00000100:00080000:3.0:1789121023.378002:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789121023.378009:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9468c191c000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121023.378033:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf70fc00 x1876028970681728/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121023.378211:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970681856:0@lo:400:kworker.0 00000100:00100000:2.0:1789121023.378282:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121023.378357:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789121023.378364:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970681600:0@lo:400:kworker.0 00000400:00000100:2.0:1789121023.378385:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876028970681600 offset 0 length 224: 4 00000100:00100000:2.0:1789121023.378540:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970681984:0@lo:400:kworker.0 00000100:00100000:2.0:1789121023.378568:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121023.378591:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970682496:0@lo:400:kworker.0 00000100:00100000:2.0:1789121023.378613:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121023.378645:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789121023.378651:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970682112:0@lo:400:kworker.0 00000100:00100000:2.0:1789121023.378672:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121023.378686:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970682624:0@lo:400:kworker.0 00000100:00100000:2.0:1789121023.378708:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121023.378738:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970681856 00000100:00100000:2.0:1789121023.378746:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970681856 00000100:00100000:2.0:1789121023.378780:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970681984 00000100:00100000:2.0:1789121023.378783:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970681984 00000100:00100000:2.0:1789121023.378792:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970682496 00000100:00100000:2.0:1789121023.378794:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970682496 00000100:00100000:2.0:1789121023.378845:0:11088:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970682112 00000100:00100000:2.0:1789121023.378849:0:11088:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970682112 00000100:00100000:2.0:1789121023.378872:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1789121023.378880:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970682496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121023.378930:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1876028970682496:12345-0@lo:400:kworker.0 Request processed in 51us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121023.378937:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1789121023.378954:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1789121023.378960:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970682112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121023.378997:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970682112:12345-0@lo:400:kworker.0 Request processed in 38us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121023.379003:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:2.0:1789121023.379015:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789121023.379019:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876028970681856:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789121023.379024:0:11088:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789121023.379049:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ecf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3645:x1876028970681856:12345-0@lo:400:kworker.0 Request processed in 29us (768us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789121023.379055:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789121023.379066:0:11088:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789121023.379070:0:11088:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1876028970681984:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789121023.379074:0:11088:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789121023.379265:0:11088:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839ed680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3646:x1876028970681984:12345-0@lo:400:kworker.0 Request processed in 193us (696us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789121023.379272:0:11088:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789121023.379294:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970682624 00000100:00100000:2.0:1789121023.379297:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970682624 00000100:00100000:2.0:1789121023.379325:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789121023.379331:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970682624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121023.379360:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970682624:12345-0@lo:400:kworker.0 Request processed in 29us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121023.379366:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00080000:2.0:1789121023.379403:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9468bf70c3c0 x1876028970682112/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121023.379416:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970682112:0@lo:400:kworker.0 00000100:00100000:2.0:1789121023.379430:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970682624:0@lo:400:kworker.0 00000100:00080000:2.0:1789121023.379448:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789121023.379453:0:3646:0:(import.c:65:import_set_state_nolock()) ffff94689df21800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789121023.379456:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1789121023.380301:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970681728:0@lo:38:kworker.0 00000100:00100000:1.0:1789121023.380349:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121023.380458:0:12532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970681728 00000100:00100000:3.0:1789121023.380463:0:12532:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970681728 00000100:00100000:3.0:1789121023.380504:0:12532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789121023.380510:0:12532:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876028970681728:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789121023.380529:0:12532:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789121023.380561:0:12532:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876028970681728:12345-0@lo:38:kworker.0 Request processed in 50us (211us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789121023.380567:0:12532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789121023.380682:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970682240:0@lo:400:kworker.0 00000100:00100000:0.0:1789121023.380715:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121023.380738:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121023.380744:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970682368:0@lo:400:kworker.0 00000100:00100000:0.0:1789121023.380768:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121023.380794:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970682368 00000100:00100000:0.0:1789121023.380798:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970682368 00000100:00100000:0.0:1789121023.380843:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789121023.380848:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876028970682368:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789121023.380854:0:6520:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789121023.380883:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1876028970682368:12345-0@lo:400:kworker.0 Request processed in 33us (114us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789121023.380889:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00080000:0.0:1789121023.380907:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789121023.380912:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789121023.380921:0:9116:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970682240 00000100:00100000:0.0:1789121023.380924:0:9116:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970682240 00000100:00100000:0.0:1789121023.380954:0:9116:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1789121023.380962:0:9116:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970682240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121023.380997:0:9116:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970682240:12345-0@lo:400:kworker.0 Request processed in 36us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121023.381003:0:9116:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:0.0:1789121023.381030:0:3644:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789121023.381034:0:3644:0:(import.c:65:import_set_state_nolock()) ffff946783263000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789121023.381038:0:3644:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789121023.381043:0:3644:0:(import.c:65:import_set_state_nolock()) ffff946783263000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121023.381069:0:3644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 252 00000100:00080000:0.0:1789121023.381076:0:3644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff946783263000 using connection 192.168.202.132@tcp/0@lo 00000100:00080000:1.0:1789121023.381430:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468c191c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121023.381435:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789121023.381438:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970681728:0@lo:38:kworker.0 00000100:00100000:0.0:1789121023.381706:0:3644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468938e8f00 x1876028970682880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789121023.381757:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970682880:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789121023.381790:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121023.383242:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970682368:0@lo:400:kworker.0 00000100:00100000:0.0:1789121023.383278:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970682240:0@lo:400:kworker.0 00000100:00100000:0.0:1789121023.383307:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970682752:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121023.383352:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789121023.383399:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121023.383416:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970682880 00000100:00100000:0.0:1789121023.383422:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970682880 00000100:00100000:0.0:1789121023.383458:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789121023.383464:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876028970682880:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1789121023.383484:0:9342:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1789121023.400863:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789121023.400890:0:3645:0:(import.c:65:import_set_state_nolock()) ffff94689e112000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789121023.400896:0:3645:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1789121023.400902:0:3645:0:(import.c:65:import_set_state_nolock()) ffff94689e112000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121023.400905:0:3645:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 205 00000100:00080000:3.0:1789121023.400914:0:3645:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff94689e112000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121023.400949:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf70e580 x1876028970683008/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121023.400966:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970681856:0@lo:400:kworker.0 00000100:00100000:0.0:1789121023.405796:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848fb0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876028970682880:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 22323us (23997us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789121023.405809:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1789121023.405900:0:8436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970682752 00000100:00100000:0.0:1789121023.405908:0:8436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970682752 00000100:00100000:0.0:1789121023.405955:0:8436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789121023.405963:0:8436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970682752:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789121023.405994:0:8436:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1789121023.406193:0:8436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ea940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970682752:12345-0@lo:13:osp-pre-0-1.0 Request processed in 229us (22840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121023.406200:0:8436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789121023.406264:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970682752:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789121023.406380:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783263000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121023.406386:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789121023.406389:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970682880:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1789121023.406410:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876028970683008:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1789121023.406447:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121023.407273:0:6520:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970683008 00000100:00100000:0.0:1789121023.407281:0:6520:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970683008 00000100:00100000:0.0:1789121023.407325:0:6520:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789121023.407331:0:6520:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876028970683008:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:0.0:1789121023.407350:0:6520:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1789121023.407399:0:6520:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848f9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876028970683008:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 66us (951us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789121023.407405:0:6520:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:1.0:1789121023.407503:0:3643:0:(import.c:65:import_set_state_nolock()) ffff94689e112000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121023.407508:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789121023.407512:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876028970683008:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1789121023.415249:0:3646:0:(import.c:65:import_set_state_nolock()) ffff94689df21800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121023.415264:0:3646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 229 00000100:00080000:2.0:1789121023.415274:0:3646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94689df21800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121023.415331:0:3646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b9c3a580 x1876028970683136/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121023.415390:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970683136:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:3.0:1789121023.415457:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121023.415512:0:9342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970683136 00000100:00100000:3.0:1789121023.415520:0:9342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970683136 00000100:00100000:3.0:1789121023.415560:0:9342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789121023.415567:0:9342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876028970683136:12345-0@lo:38:ptlrpcd_00_02.0 00010000:00020000:3.0:1789121023.415589:0:9342:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789121023.416924:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970681984:0@lo:400:kworker.0 00010000:00080000:2.0:1789121023.416976:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff9468bf70de00 x1876028970682496/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121023.416989:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3646:1876028970682496:0@lo:400:kworker.0 00000100:00100000:3.0:1789121023.423902:0:9342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876028970683136:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 8324us (8435us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789121023.423916:0:9342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1789121023.424915:0:3643:0:(import.c:65:import_set_state_nolock()) ffff94689df21800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121023.424924:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789121023.424929:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c3a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970683136:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:3.0:1789121023.762935:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121023.893621:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970683264:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789121023.893696:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121023.893891:0:14522:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970683264 00000100:00100000:0.0:1789121023.893899:0:14522:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970683264 00000100:00100000:0.0:1789121023.893945:0:14522:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789121023.893953:0:14522:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970683264:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789121023.893980:0:14522:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789121023.894026:0:14522:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3a580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970683264:12345-0@lo:13:osp-pre-1-1.0 Request processed in 73us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121023.894034:0:14522:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789121023.894173:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970683264:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789121024.787732:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789121025.758641:0:16066:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1789121025.778044:0:16066:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789121025.778103:0:16066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.778118:0:16066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.778125:0:16066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.778147:0:16066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.778167:0:16066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789121025.778173:0:16066:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789121025.778200:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789121025.778204:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789121025.778210:0:16066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789121025.778216:0:16066:0:(import.c:65:import_set_state_nolock()) ffff94689e112000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789121025.778222:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789121025.778223:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789121025.778226:0:16066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1789121025.779122:0:16066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779133:0:16066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779139:0:16066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779145:0:16066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779168:0:16066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789121025.779175:0:16066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779196:0:16066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779202:0:16066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779208:0:16066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779222:0:16066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789121025.779228:0:16066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779235:0:16066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779242:0:16066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779248:0:16066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779262:0:16066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1789121025.779277:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789121025.779283:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779290:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887083e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121025.779300:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779309:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121025.779317:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121025.779322:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789121025.779325:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789121025.779327:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789121025.779364:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779370:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121025.779392:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779399:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887083e00/0xb74d2367a830f388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f38f expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779411:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789121025.779415:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779421:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c2049400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121025.779424:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779430:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121025.779443:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121025.779448:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789121025.779451:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:2.0:1789121025.779474:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779480:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121025.779488:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779500:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c2049400/0xb74d2367a830f396 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f39d expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779514:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121025.779519:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779529:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121025.779534:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779542:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121025.779549:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121025.779555:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789121025.779563:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789121025.779565:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789121025.779582:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779588:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121025.779605:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779612:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a830f270 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f277 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779630:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121025.779633:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779639:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f10400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121025.779642:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779649:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121025.779655:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121025.779659:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789121025.779661:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789121025.779664:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789121025.779678:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779693:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121025.779702:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779708:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468a2f10400/0xb74d2367a830f69f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830f6a6 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121025.779721:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121025.779724:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121025.779728:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121025.779747:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970683392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121025.779862:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121025.779928:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789121025.779936:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970683520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121025.779966:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121025.780001:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970683392 00000100:00100000:0.0:1789121025.780009:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970683392 00000100:00100000:2.0:1789121025.780015:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970683776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121025.780043:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121025.780046:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970683520 00000100:00100000:0.0:1789121025.780050:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970683520 00000100:00100000:2.0:1789121025.780065:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789121025.780069:0:6503:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970683776 00000100:00100000:2.0:1789121025.780073:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970683648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121025.780073:0:6503:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970683776 00000100:00100000:0.0:1789121025.780089:0:6503:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789121025.780098:0:6503:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3646:x1876028970683392:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121025.780099:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00020000:0.0:1789121025.780108:0:6503:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789121025 with bad export cookie 13208252210257915478 00000100:00100000:2.0:1789121025.780123:0:9525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970683648 00000100:00100000:2.0:1789121025.780129:0:9525:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970683648 00000100:00100000:2.0:1789121025.780147:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789121025.780152:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1876028970683520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789121025.780157:0:9525:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789121025 with bad export cookie 13208252210257915478 00000100:00100000:2.0:1789121025.780198:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1876028970683520:12345-0@lo:103:ldlm_bl.0 Request processed in 44us (232us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789121025.780212:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789121025.780229:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789121025.780234:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876028970683776:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789121025.780238:0:9525:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789121025 with bad export cookie 13208252210257915478 00000100:00100000:2.0:1789121025.780266:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468835ea050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876028970683776:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (223us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789121025.780274:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789121025.780286:0:9525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789121025.780289:0:9525:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876028970683648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789121025.780293:0:9525:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789121025 with bad export cookie 13208252210257915478 00000100:00100000:2.0:1789121025.780315:0:9525:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2f840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3645:x1876028970683648:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (217us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789121025.780320:0:9525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789121025.780345:0:3645:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789121025.780350:0:3645:0:(import.c:65:import_set_state_nolock()) ffff946893206000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1789121025.780354:0:3645:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.132@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1789121025.780437:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121025.780444:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789121025.780496:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.132@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:1.0:1789121025.780886:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121025.804397:0:6503:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3646:x1876028970683392:12345-0@lo:103:ldlm_bl.0 Request processed in 24292us (24528us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789121025.804412:0:6503:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1789121025.811362:0:16066:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10a00/0xb74d2367a830ef59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121025.811400:0:16066:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10a00/0xb74d2367a830ef59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121025.811408:0:16066:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468a2f10a00/0xb74d2367a830ef59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121025.811420:0:16066:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468a2f10a00/0xb74d2367a830ef59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121025.811448:0:16066:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789121025.811454:0:16066:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1789121025.811460:0:16066:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1789121025.811513:0:16066:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1789121025.811517:0:16066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1789121025.811523:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121025.811529:0:16066:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1789121025.811538:0:16066:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9468b9c34800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789121025.811544:0:16066:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff946782aed000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789121025.811550:0:16066:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9468c0871a48) has exports, disconnecting them 00000020:00080000:0.0:1789121025.811555:0:16066:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9468b9c34800), last request at 1789121023 00000020:00000080:0.0:1789121025.811563:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f238 00000100:00080000:0.0:1789121025.811584:0:16066:0:(import.c:65:import_set_state_nolock()) ffff9468b9c30800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789121025.811636:0:16066:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468b9c34800): rc 0 00000020:00000080:0.0:1789121025.811639:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468b9c34800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1789121025.811649:0:16066:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff946782aed000), last request at 1789121023 00000020:00000080:0.0:1789121025.811653:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f112 00000100:00080000:0.0:1789121025.811658:0:16066:0:(import.c:65:import_set_state_nolock()) ffff946782ae8800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789121025.811668:0:16066:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff946782aed000): rc 0 00000020:00000080:0.0:1789121025.811677:0:16066:0:(genops.c:885:class_export_put()) final put ffff946782aed000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1789121025.811685:0:16066:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffa04ac1817ae0 00000100:00080000:0.0:1789121025.811704:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789121025.811714:0:16066:0:(client.c:3601:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff9468938ea580 x1876028970681344/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789121037 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121025.811729:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00010000:00010000:1.0:1789121025.811846:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121025.811854:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468a2f10a00/0xb74d2367a830ef59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121025.811862:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468a2f10a00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121025.811866:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f10a00/0xb74d2367a830ef59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121025.811874:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468a2f10a00/0xb74d2367a830ef59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121025.811882:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f10a00/0xb74d2367a830ef59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121025.811888:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789121025.811891:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789121025.811893:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00080000:0.0:1789121025.812905:0:16066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789121025.812915:0:16066:0:(import.c:65:import_set_state_nolock()) ffff9468c191c000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1789121025.813062:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789121025.813066:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:0.0:1789121025.813081:0:16066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789121025.813139:0:16066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789121025.813163:0:16066:0:(import.c:65:import_set_state_nolock()) ffff9468bf682800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789121025.813180:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789121025.813182:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:0.0:1789121025.813191:0:16066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789121025.813256:0:16066:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789121025.813266:0:16066:0:(import.c:65:import_set_state_nolock()) ffff9468afe5c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789121025.813292:0:16066:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9468c0871a48) has no exports 00000100:00080000:2.0:1789121025.821038:0:3645:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.132@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1789121025.821044:0:3645:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789121025.821054:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9468bf70f480 x1876028970681600/t0(0) o400->MGC192.168.202.132@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789121039 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121025.821068:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946784b2c000 x1876028970683392/t0(0) o103->MGC192.168.202.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789121041 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121025.821078:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946784b2f480 x1876028970683520/t0(0) o103->MGC192.168.202.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789121041 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789121025.821081:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121025.821088:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946784b2e580 x1876028970683776/t0(0) o103->MGC192.168.202.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789121041 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1789121025.821095:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9468b9c34800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00100000:2.0:1789121025.821117:0:3645:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946784b2da40 x1876028970683648/t0(0) o103->MGC192.168.202.132@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789121041 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000020:00000080:0.0:1789121025.821160:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946782aed000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789121025.821183:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468b9c30800 for lustre-MDT0001 00000020:00000080:0.0:1789121025.821186:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946782ae8800 for lustre-MDT0001 00010000:00010000:0.0:1789121025.821197:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789121025.821358:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789121025.821362:0:3645:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789121025.821365:0:3645:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789121025.822150:0:3646:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff946893206000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1789121025.822179:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970683392:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121025.822351:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:3646:1876028970683520:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121025.822413:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970683904:0@lo:9:umount.0 00000100:00100000:3.0:1789121025.822506:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121025.822537:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970684032:0@lo:9:umount.0 00000100:00100000:3.0:1789121025.822564:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789121025.822590:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121025.822603:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970683904 00000100:00100000:3.0:1789121025.822611:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970683904 00000100:00100000:3.0:1789121025.822667:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970684032 00000100:00100000:3.0:1789121025.822670:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970684032 00000100:00100000:3.0:1789121025.822689:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789121025.822697:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876028970683904:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789121025.822721:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f15f 00000100:00080000:3.0:1789121025.822730:0:8434:0:(import.c:65:import_set_state_nolock()) ffff946782aeb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789121025.822766:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1789121025.822931:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3643:x1876028970683904:12345-0@lo:9:umount.0 Request processed in 233us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121025.822939:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789121025.822956:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789121025.822962:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3643:x1876028970684032:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789121025.822972:0:8434:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f2af 00000100:00080000:3.0:1789121025.822977:0:8434:0:(import.c:65:import_set_state_nolock()) ffff946783260800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789121025.822996:0:8434:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:3.0:1789121025.823074:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3643:x1876028970684032:12345-0@lo:9:umount.0 Request processed in 112us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121025.823080:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1789121025.823181:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789121025.823185:0:6514:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789121025.823299:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468bf682800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789121025.823313:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789121025.823315:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789121025.823319:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970683904:0@lo:9:umount.0 00000100:00080000:3.0:1789121025.823328:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468afe5c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789121025.823335:0:3643:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789121025.823337:0:3643:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789121025.823339:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970684032:0@lo:9:umount.0 00010000:00010000:3.0:1789121025.823367:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121025.823376:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121025.823431:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970681344:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789121025.823971:0:6507:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468a2f10a00/0xb74d2367a830ef59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121025.823982:0:6507:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789121025.824037:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:03a1864a-46e4-4762-8a00-3ced97b06903:0:1876028970684160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789121025.824077:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468a2f10a00/0xb74d2367a830ef59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121025.824085:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468a2f10a00/0xb74d2367a830ef59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xb74d2367a830ef60 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789121025.825803:0:3645:0:(import.c:65:import_set_state_nolock()) ffff946893206000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121025.825817:0:3645:0:(import.c:510:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 181 00000100:00080000:2.0:1789121025.825840:0:3645:0:(import.c:624:import_select_connection()) MGC192.168.202.132@tcp: import ffff946893206000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121025.825880:0:3645:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783c2f0c0 x1876028970684288/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121025.825927:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970683776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121025.825937:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970681600:0@lo:400:kworker.0 00000100:00100000:2.0:1789121025.825962:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:03a1864a-46e4-4762-8a00-3ced97b06903:3645:1876028970683648:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789121025.827322:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121025.827324:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121025.827327:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121025.827349:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:03a1864a-46e4-4762-8a00-3ced97b06903:3643:1876028970684288:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1789121025.827399:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876028970684288 offset 0 length 520: 4 00000020:00080000:1.0:1789121025.845490:0:16066:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9468c0871a48) has no exports 00000020:01000000:0.0:1789121025.938202:0:16066:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946887d7e5a0 - data ffff9468983a4948/ffff946783170800 00000020:01000000:0.0:1789121025.938370:0:16066:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946887bea660 - data ffff9468ab1a7360/ffff9468b998a800 00000001:00000004:2.0:1789121025.956500:0:16066:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:0.0:1789121026.032645:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789121026.032658:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:0.0:1789121026.032668:0:16066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789121026.036876:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789121026.036884:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:0.0:1789121026.036944:0:16066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789121026.036947:0:16066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789121026.042102:0:8908:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789121026.042112:0:8908:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:3.0:1789121026.042132:0:8908:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789121026.044585:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789121026.044593:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:0.0:1789121026.044620:0:16066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789121026.044623:0:16066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789121026.044999:0:9814:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789121026.045005:0:9814:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:2.0:1789121026.045034:0:9814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789121026.046421:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ef7c 00000020:00000080:3.0:1789121026.046433:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468afd48000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789121026.052033:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afd48000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1789121026.052811:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ef91 00000020:00000080:3.0:1789121026.052845:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468c0880800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789121026.052859:0:16066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:3.0:1789121026.052865:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121026.052872:0:16066:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789121026.052876:0:16066:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9468c0870000) has no exports 00000004:01000000:3.0:1789121026.053056:0:16066:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789121026.053074:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f29a 00000020:00000080:3.0:1789121026.053079:0:16066:0:(genops.c:885:class_export_put()) final put ffff9467821dd000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789121026.053084:0:16066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789121026.053088:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121026.053095:0:16066:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789121026.053097:0:16066:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff946783c7ced8) has no exports 00000020:00000080:3.0:1789121026.053103:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f293 00000020:00000080:3.0:1789121026.053107:0:16066:0:(genops.c:885:class_export_put()) final put ffff946883586800/lustre-MDT0001-osd_UUID 00010000:01000000:3.0:1789121026.053494:0:16066:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789121026.053499:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789121026.053504:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:3.0:1789121026.053510:0:16066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789121026.053513:0:16066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789121026.053559:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121026.053567:0:16066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789121026.053574:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f158 00000020:00000080:3.0:1789121026.053579:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468bf681800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789121026.053582:0:16066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:3.0:1789121026.053586:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121026.053590:0:16066:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789121026.053592:0:16066:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9467821e8000) has no exports 00000020:00000080:3.0:1789121026.053597:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f151 00000020:00000080:3.0:1789121026.053600:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468bf684800/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789121026.053694:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c0880800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1789121026.053728:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9467821dd000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789121026.053742:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff946883586800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789121026.053756:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468afe5c800 for lustre-OST0001-osc-MDT0001 00000020:00000080:2.0:1789121026.053770:0:8921:0:(genops.c:885:class_export_put()) final put ffff9468bf6a9000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789121026.053774:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468bf6a9000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:2.0:1789121026.053784:0:8921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789121026.053977:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468bf681800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1789121026.053991:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468bf684800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:3.0:1789121026.054018:0:16066:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:3.0:1789121026.054022:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789121026.054024:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:3.0:1789121026.054027:0:16066:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789121026.054029:0:16066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789121026.054063:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121026.054069:0:16066:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:3.0:1789121026.054079:0:16066:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1789121026.054084:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830efb4 00000020:00000080:3.0:1789121026.054095:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468c0880000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:3.0:1789121026.054100:0:16066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:3.0:1789121026.054103:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121026.054107:0:16066:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789121026.054109:0:16066:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff94688415ced8) has no exports 00000020:00000080:3.0:1789121026.054113:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830efad 00000020:00000080:3.0:1789121026.054116:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468c191a000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789121026.054195:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468bf682800 for lustre-OST0000-osc-MDT0001 00000020:00000080:2.0:1789121026.054207:0:8921:0:(genops.c:885:class_export_put()) final put ffff9467821d9800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789121026.054212:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9467821d9800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:2.0:1789121026.054221:0:8921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789121026.054334:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c0880000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:2.0:1789121026.054344:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c191a000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1789121026.054992:0:16066:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:2.0:1789121026.054998:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789121026.055002:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1789121026.055008:0:16066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789121026.055074:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121026.055082:0:16066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789121026.055109:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121026.055112:0:16066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789121026.055117:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468afd4e800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789121026.055120:0:16066:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afd4e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:0.0:1789121026.055127:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9468c191c000 for lustre-MDT0000-osp-MDT0001 00000020:01000000:2.0:1789121026.055128:0:16066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789121026.055138:0:8921:0:(genops.c:885:class_export_put()) final put ffff9468afc6a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789121026.055141:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afc6a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:0.0:1789121026.055151:0:8921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789121026.056469:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ef98 00000020:00000080:2.0:1789121026.056480:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468c0885000/lustre-MDD0001_UUID 00000020:01000000:2.0:1789121026.056499:0:16066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:2.0:1789121026.056504:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121026.056511:0:16066:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789121026.056515:0:16066:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9468c0873490) has no exports 00000020:00000080:0.0:1789121026.056519:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c0885000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:2.0:1789121026.056541:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121026.056546:0:16066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:2.0:1789121026.056548:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468840c2800/lustre-MDD0001_UUID 00000020:00000080:2.0:1789121026.056550:0:16066:0:(genops.c:844:class_export_destroy()) destroying export ffff9468840c2800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:2.0:1789121026.056586:0:16066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:2.0:1789121026.058343:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ef9f 00000020:00000080:2.0:1789121026.058353:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468c0886000/lustre-MDT0001-osd_UUID 00000020:01000004:2.0:1789121026.058381:0:16066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946883582800 from lustre-MDT0001, refs=2 00000020:01000004:2.0:1789121026.058385:0:16066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946883582800 2 00000020:01000004:2.0:1789121026.058388:0:16066:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946883582800 from lustre-MDT0001 00000020:00000080:0.0:1789121026.058393:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c0886000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1789121026.058414:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121026.058421:0:16066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:2.0:1789121026.058425:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468afd4d000/lustre-MDT0001_UUID 00000020:00000080:2.0:1789121026.058427:0:16066:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afd4d000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:2.0:1789121026.059443:0:16066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:2.0:1789121026.059522:0:16066:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:2.0:1789121026.059528:0:16066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:2.0:1789121026.059533:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121026.059538:0:16066:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789121026.059546:0:16066:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9468afd4d800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789121026.059552:0:16066:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9468afc79a48) has exports, disconnecting them 00000020:00080000:2.0:1789121026.059558:0:16066:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9468afd4d800), last request at 1789120755 00000020:00000080:2.0:1789121026.059562:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830eff3 00000020:00080000:2.0:1789121026.059579:0:16066:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468afd4d800): rc 0 00000020:00000080:2.0:1789121026.059583:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468afd4d800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789121026.059806:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afd4d800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1789121026.071891:0:16066:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1789121026.071901:0:16066:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789121026.071906:0:16066:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789121026.071915:0:16066:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789121026.071951:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94689e112000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1789121026.072150:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121026.072159:0:16066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1789121026.072165:0:16066:0:(genops.c:885:class_export_put()) final put ffff94689df25000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1789121026.072170:0:16066:0:(genops.c:844:class_export_destroy()) destroying export ffff94689df25000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1789121026.072191:0:16066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1789121026.072275:0:16066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946883582800 1 00000020:00000080:0.0:1789121026.072281:0:16066:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ef2f 00000020:00000080:0.0:1789121026.072287:0:16066:0:(genops.c:885:class_export_put()) final put ffff9468afc6b000/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1789121026.072296:0:16066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1789121026.072305:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468afc6b000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1789121026.072316:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121026.072320:0:16066:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789121026.072324:0:16066:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff946882bf3490) has no exports 00000020:00000080:0.0:1789121026.111105:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121026.111119:0:16066:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789121026.111125:0:16066:0:(genops.c:885:class_export_put()) final put ffff946883587800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789121026.111130:0:16066:0:(genops.c:844:class_export_destroy()) destroying export ffff946883587800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789121026.111141:0:16066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789121026.111418:0:16066:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff946883585800 00000020:01000000:0.0:1789121026.111440:0:16066:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789121026.111445:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121026.111449:0:16066:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789121026.111454:0:16066:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9468ab901a48) has no exports 00000100:00100000:0.0:1789121026.111545:0:11088:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff946783ba1600:11088] 4 exiting: rc = 0 00000100:00100000:0.0:1789121026.111734:0:6520:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9468a0857000:6520] 2 exiting: rc = 0 00000100:00100000:0.0:1789121026.111906:0:6518:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9468a0857400:6518] 0 exiting: rc = 1 00000100:00100000:3.0:1789121026.112338:0:9342:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9468c190f600:9342] 3 exiting: rc = 0 00000100:00100000:3.0:1789121026.112423:0:6519:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9468a0856e00:6519] 1 exiting: rc = 0 00000100:00100000:0.0:1789121026.112495:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112504:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112510:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112516:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112523:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112529:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112535:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112541:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112549:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112554:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112561:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112567:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112588:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112593:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112669:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112677:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112683:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112688:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112694:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112701:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112706:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112712:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112718:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112724:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112728:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112733:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112738:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112744:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112749:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112754:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112759:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112775:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112782:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112788:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112793:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112798:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112804:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112810:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112816:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112843:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112849:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112855:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112860:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112865:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112871:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112878:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112885:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112899:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112904:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112910:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112915:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112921:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112926:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112932:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112938:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112944:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112949:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112954:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112960:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112965:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112970:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112975:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112981:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.112987:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.116507:0:6521:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9468a0414c00:6521] 0 exiting: rc = 1 00000100:00100000:3.0:1789121026.117211:0:6522:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9468abbe9e00:6522] 1 exiting: rc = 0 00000100:00100000:0.0:1789121026.117351:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117361:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117367:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117375:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117380:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117386:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117393:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117399:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117404:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117411:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117418:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117427:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117435:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117443:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117449:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117456:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117477:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117485:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117505:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117513:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117520:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117527:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117534:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117539:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117546:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117554:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117570:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117580:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117588:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117668:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117677:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117682:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117687:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117692:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117697:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117702:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117707:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117712:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117717:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117721:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117726:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117731:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117736:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117741:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117747:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117752:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117757:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117763:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117769:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117773:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117779:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117785:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117790:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117805:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117810:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117815:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117843:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117849:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117855:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117859:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117864:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117869:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117874:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.117880:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.118414:0:6523:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9468ab90e600:6523] 0 exiting: rc = 1 00000100:00100000:1.0:1789121026.118426:0:6524:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9468ab90e000:6524] 1 exiting: rc = 0 00000100:00100000:3.0:1789121026.118538:0:12532:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff946783f2b600:12532] 2 exiting: rc = 0 00000100:00100000:0.0:1789121026.118659:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118675:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118684:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118695:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118702:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118721:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118728:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118734:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118740:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118749:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118757:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118764:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118770:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118777:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118783:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118790:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.118797:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120501:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120522:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120532:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120540:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120549:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120557:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120566:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120589:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120945:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120959:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120965:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120971:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.120994:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121001:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121008:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121014:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121020:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121025:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121112:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121121:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121129:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121138:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121147:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121155:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121179:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121186:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121191:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121197:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121287:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121295:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121301:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121308:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121314:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121325:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121345:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121359:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121399:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121423:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121429:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121441:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121448:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121452:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121478:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121484:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121490:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121496:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.121501:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.136913:0:6525:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9468ab90fc00:6525] 0 exiting: rc = 1 00000100:00100000:3.0:1789121026.137453:0:6526:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9468ab90e400:6526] 1 exiting: rc = 0 00000100:00100000:0.0:1789121026.137592:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137611:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137616:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137622:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137627:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137632:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137638:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137643:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137647:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137652:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137658:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137663:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137667:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137672:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137678:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137682:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137688:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137692:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137698:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137703:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137708:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137712:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137717:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137723:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137727:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137734:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137738:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137744:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137749:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137753:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137787:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137795:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137803:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137808:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137815:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137842:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137850:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137856:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137863:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137869:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137876:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137884:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137891:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137896:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137901:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137907:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137914:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137921:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137928:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137935:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137943:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137950:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137956:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137963:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137970:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137977:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137986:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.137993:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138001:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138008:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138015:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138022:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138031:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138042:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.138514:0:6527:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9468ab90ec00:6527] 0 exiting: rc = 1 00000100:00100000:2.0:1789121026.138869:0:6528:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9468ab90f400:6528] 1 exiting: rc = 0 00000100:00100000:0.0:1789121026.138923:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138943:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138951:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138957:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138963:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138968:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138974:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138980:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138985:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138991:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.138996:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139002:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139007:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139012:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139017:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139023:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139028:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139033:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139038:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139044:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139049:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139054:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139059:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139064:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139070:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139079:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139089:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139096:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139102:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139107:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139112:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139117:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139122:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139127:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139133:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139138:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139151:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139157:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139162:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139168:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139174:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139179:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139185:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139191:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139199:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139205:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139210:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139215:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139219:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139223:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139228:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139233:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139238:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139242:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139247:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139252:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139257:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139263:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139268:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139272:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139277:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139281:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139287:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121026.139292:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.140986:0:6529:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9468ab90f000:6529] 0 exiting: rc = 1 00000100:00100000:0.0:1789121026.141527:0:6530:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9468ab90e200:6530] 1 exiting: rc = 0 00000100:00100000:3.0:1789121026.146926:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146936:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146942:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146947:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146952:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146957:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146962:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146967:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146972:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146978:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146983:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146989:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.146995:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147000:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147006:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147034:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147040:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147045:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147051:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147056:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147060:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147065:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147071:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147076:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147081:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147086:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147091:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147095:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147100:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147105:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147111:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147116:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147121:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147125:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147130:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147135:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147140:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147145:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147150:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147157:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147162:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147168:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147173:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147177:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147182:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147187:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147192:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147196:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147202:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147207:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147220:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147225:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147244:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147249:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147253:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147258:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147262:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147267:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147272:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147277:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147281:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147285:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147290:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.147295:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121026.152047:0:6533:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9468ab90f600:6533] 2 exiting: rc = 0 00000100:00100000:0.0:1789121026.152510:0:6531:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9468aa425400:6531] 0 exiting: rc = 1 00000100:00100000:2.0:1789121026.152795:0:6532:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9468ab90fe00:6532] 1 exiting: rc = 0 00000100:00100000:3.0:1789121026.152968:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.152975:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.152979:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.152982:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.152986:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.152989:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.152993:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.152996:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153000:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153003:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153007:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153011:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153015:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153019:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153023:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153026:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153030:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153033:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153036:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153040:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153044:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153057:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153061:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153065:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153078:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153082:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153086:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153089:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153093:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153096:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153100:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153104:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153109:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153114:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153119:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153125:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153129:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153134:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153139:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153145:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153151:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153157:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153162:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153169:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153175:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153180:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153186:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153193:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153212:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153220:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153226:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153233:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153240:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153245:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153251:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153256:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153270:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153275:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153280:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153286:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153291:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153297:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153302:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121026.153307:0:16066:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789121026.161369:0:16066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121026.161382:0:16066:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789121026.161388:0:16066:0:(genops.c:885:class_export_put()) final put ffff946893204800/MDS_uuid 00000020:00000080:2.0:1789121026.161392:0:16066:0:(genops.c:844:class_export_destroy()) destroying export ffff946893204800/MDS_uuid for MDS 00000020:01000000:2.0:1789121026.161402:0:16066:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789121026.161563:0:16066:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1789121026.834599:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121027.859740:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789121028.503409:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789121028.503419:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121028.503422:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789121028.503434:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789121028.503446:0:8921:0:(import.c:65:import_set_state_nolock()) ffff94689df21800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121028.503454:0:8921:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1789121028.503460:0:8921:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789121028.503466:0:8921:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94689df21800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121028.503503:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468938ead00 x1876028970684416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789121028.503565:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789121028.503569:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789121028.503571:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946783263000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121028.503575:0:8921:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 473 00000100:00080000:0.0:1789121028.503577:0:8921:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789121028.503581:0:8921:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff946783263000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121028.503592:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468938ea1c0 x1876028970684672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789121028.503638:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970684800:0@lo:400:kworker.0 00000400:00000100:0.0:1789121028.503690:0:3644:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970684800 offset 0 length 224: 4 00000100:00100000:2.0:1789121028.504021:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970684544:0@lo:400:kworker.0 00000400:00000100:2.0:1789121028.504049:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970684544 offset 0 length 224: 4 00000100:00100000:3.0:1789121028.504148:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970684416:0@lo:38:kworker.0 00000400:00000100:3.0:1789121028.504167:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970684416 offset 0 length 520: 4 00000100:00100000:3.0:1789121028.504177:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970684672:0@lo:38:kworker.0 00000400:00000100:3.0:1789121028.504185:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970684672 offset 0 length 520: 4 00010000:00010000:3.0:1789121028.889070:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789121029.777350:0:16266:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1789121029.797435:0:16266:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789121029.797492:0:16266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121029.797508:0:16266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121029.797515:0:16266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121029.797523:0:16266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121029.797547:0:16266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789121029.797608:0:16266:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789121029.797646:0:16266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789121029.797659:0:16266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9468938ead00 x1876028970684416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789121043 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121029.797736:0:16266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789121029.797743:0:16266:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789121029.797750:0:16266:0:(import.c:65:import_set_state_nolock()) ffff94689df21800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789121029.797754:0:16266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789121029.797759:0:16266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9468938ead00 x1876028970684416/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789121043 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:1.0:1789121029.797798:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121029.797806:0:6507:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121029.797814:0:6507:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c2048400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121029.797818:0:6507:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121029.797850:0:6507:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121029.797858:0:6507:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121029.797864:0:6507:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789121029.797867:0:6507:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789121029.797870:0:6507:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789121029.797884:0:6507:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946893206000 00010000:00010000:1.0:1789121029.797888:0:6507:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121029.797894:0:6507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c2048400/0xb74d2367a830f36c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f373 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121029.797919:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121029.797921:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121029.797923:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121029.798345:0:16266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789121029.798438:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970684416:0@lo:38:kworker.0 00000100:00100000:3.0:1789121029.798489:0:16266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789121029.799673:0:16266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789121029.799685:0:16266:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9468938eb480 x1876028970684544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121044 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121029.799920:0:16266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789121029.799927:0:16266:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1789121029.799956:0:16266:0:(import.c:65:import_set_state_nolock()) ffff94689df20000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789121029.800047:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876028970684928:0@lo:39:umount.0 00000400:00000100:0.0:1789121029.800103:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970684928 offset 0 length 224: 4 00000100:00100000:2.0:1789121029.800287:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970684544:0@lo:400:kworker.0 00010000:00010000:3.0:1789121029.905985:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789121030.546038:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789121030.546048:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121030.546051:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789121030.546054:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789121030.546255:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970685056:0@lo:400:kworker.0 00000400:00000100:1.0:1789121030.546306:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970685056 offset 0 length 224: 4 00010000:00010000:0.0:1789121030.930128:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789121031.572807:0:9516:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789121031.572841:0:9516:0:(genops.c:885:class_export_put()) final put ffff946783266000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1789121031.573065:0:8428:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789121031.573071:0:8428:0:(genops.c:885:class_export_put()) final put ffff946782aeb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789121031.573176:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946783266000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789121031.573243:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff946782aeb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789121031.573267:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783260800 for lustre-OST0001 00000020:00000080:3.0:1789121031.573273:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946782aeb000 for lustre-OST0000 00010000:00010000:3.0:1789121031.954023:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121032.978313:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789121033.554862:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121033.554876:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121033.554880:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121033.554884:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789121033.555058:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789121033.555088:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970685184:0@lo:400:kworker.0 00000400:00000100:0.0:1789121033.555168:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970685184 offset 0 length 224: 4 00010000:00010000:3.0:1789121034.002019:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121035.026239:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121035.922172:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121025/real 1789121025] req@ffff946783c2f0c0 x1876028970684288/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789121035 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121035.922213:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946783c2f0c0 x1876028970684288/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789121035 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789121035.922237:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946893206000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789121035.922269:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789121035.922274:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:03a1864a-46e4-4762-8a00-3ced97b06903:3643:1876028970684288:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1789121035.922425:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121035.922431:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1789121035.922435:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946893206000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121035.922441:0:8921:0:(import.c:510:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 476 00000100:00080000:2.0:1789121035.922447:0:8921:0:(import.c:589:import_select_connection()) MGC192.168.202.132@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789121035.922455:0:8921:0:(import.c:624:import_select_connection()) MGC192.168.202.132@tcp: import ffff946893206000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121035.922499:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783c2de00 x1876028970685312/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121035.922534:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121035.922539:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789121035.922653:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:03a1864a-46e4-4762-8a00-3ced97b06903:3643:1876028970685312:0@lo:250:kworker.0 00000400:00000100:0.0:1789121035.922727:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876028970685312 offset 0 length 520: 4 00000100:00100000:3.0:1789121035.923269:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970685440:0@lo:400:kworker.0 00000400:00000100:3.0:1789121035.923306:0:3647:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970685440 offset 0 length 224: 4 00010000:00010000:3.0:1789121036.052500:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121037.074515:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121038.098924:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121039.122102:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121040.018177:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121029/real 1789121029] req@ffff9468bf70d680 x1876028970684928/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789121039 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121040.018230:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468bf70d680 x1876028970684928/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789121039 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789121040.018266:0:3643:0:(import.c:65:import_set_state_nolock()) ffff94689df20000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789121040.018573:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876028970684928:0@lo:39:umount.0 00000100:00080000:1.0:1789121040.018778:0:16266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789121040.018786:0:16266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789121040.018792:0:16266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789121040.021133:0:16266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121040.021161:0:16266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121040.021171:0:16266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121040.021539:0:16266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121040.021668:0:16266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789121040.021680:0:16266:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121040.021688:0:16266:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121040.021695:0:16266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121040.021702:0:16266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121040.024638:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789121040.024659:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121040.024675:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c2049600 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789121040.024680:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121040.024692:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789121040.024700:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121040.024706:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789121040.024709:0:8450:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1789121040.024739:0:8450:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946893206000 00010000:00010000:3.0:1789121040.024744:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121040.024751:0:8450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c2049600/0xb74d2367a830f37a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f381 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121040.024776:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121040.024781:0:8450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121040.024788:0:8450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1800 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789121040.024791:0:8450:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121040.024875:0:8450:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789121040.024883:0:8450:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121040.024889:0:8450:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789121040.024892:0:8450:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789121040.024898:0:8450:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946893206000 00010000:00010000:3.0:1789121040.024901:0:8450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121040.024910:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121040.024912:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121040.024915:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121040.029474:0:16266:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789121040.029505:0:16266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9467838d1800/0xb74d2367a830f691 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f698 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121040.029533:0:16266:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1789121040.029545:0:16266:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1789121040.029549:0:16266:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789121040.029593:0:16266:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789121040.029599:0:16266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789121040.029614:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789121040.029621:0:16266:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789121040.029626:0:16266:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9467821eced8) has no exports 00000020:00080000:1.0:1789121040.029998:0:16266:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9467821eced8) has no exports 00010000:00010000:2.0:1789121040.039600:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789121040.046470:0:16266:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946887d7ea20 - data ffff94678252f870/ffff946783173800 00000020:01000000:0.0:1789121040.048606:0:16266:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff9467829d4000 - data ffff9468ab067000/ffff9468b9b0f800 00100000:10000000:0.0:1789121040.071953:0:16266:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789121040.091736:0:16266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f0cc 00000020:00000080:2.0:1789121040.091756:0:16266:0:(genops.c:885:class_export_put()) final put ffff9467821db800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789121040.091786:0:16266:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468b9991000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789121040.091804:0:16266:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468b9991000 2 00000020:01000004:2.0:1789121040.091808:0:16266:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9468b9991000 from lustre-OST0000 00000020:00000080:2.0:1789121040.091855:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121040.091870:0:16266:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789121040.091874:0:16266:0:(genops.c:885:class_export_put()) final put ffff9467821de000/lustre-OST0000_UUID 00000020:00000080:2.0:1789121040.091878:0:16266:0:(genops.c:844:class_export_destroy()) destroying export ffff9467821de000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789121040.091888:0:16266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:1.0:1789121040.091916:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9467821db800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1789121040.091970:0:16266:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789121040.091976:0:16266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789121040.091980:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121040.091985:0:16266:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789121040.091994:0:16266:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9468c1cf6800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789121040.092000:0:16266:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff946782859a48) has exports, disconnecting them 00000020:00080000:2.0:1789121040.092007:0:16266:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9468c1cf6800), last request at 1789120779 00000020:00000080:2.0:1789121040.092012:0:16266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f0f6 00000020:00080000:2.0:1789121040.092021:0:16266:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9468c1cf6800): rc 0 00000020:00000080:2.0:1789121040.092027:0:16266:0:(genops.c:885:class_export_put()) final put ffff9468c1cf6800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789121040.092225:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c1cf6800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789121040.093890:0:16266:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789121040.093902:0:16266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789121040.093908:0:16266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789121040.093917:0:16266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789121040.094037:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94689df21800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789121040.094249:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789121040.094259:0:16266:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789121040.094266:0:16266:0:(genops.c:885:class_export_put()) final put ffff9468c1cf7000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789121040.094270:0:16266:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c1cf7000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789121040.094284:0:16266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789121040.094386:0:16266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789121040.094391:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121040.094396:0:16266:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789121040.094414:0:16266:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff946782aee000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789121040.094430:0:16266:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff94678285b490) has exports, disconnecting them 00000020:00080000:3.0:1789121040.094435:0:16266:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff946782aee000), last request at 1789120779 00000020:00000080:3.0:1789121040.094439:0:16266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f10b 00000020:00080000:3.0:1789121040.094455:0:16266:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff946782aee000): rc 0 00000020:00000080:3.0:1789121040.094461:0:16266:0:(genops.c:885:class_export_put()) final put ffff946782aee000/lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1789121040.095203:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff946782aee000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1789121040.346398:0:16266:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789121040.346412:0:16266:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789121040.346419:0:16266:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789121040.346430:0:16266:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789121040.347067:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff94689df20000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789121040.352504:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121040.352531:0:16266:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1789121040.352542:0:16266:0:(genops.c:885:class_export_put()) final put ffff9468c1cf5800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1789121040.352549:0:16266:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c1cf5800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1789121040.352561:0:16266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1789121040.352664:0:16266:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468b9991000 1 00000020:00000080:2.0:1789121040.352673:0:16266:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f094 00000020:00000080:2.0:1789121040.352681:0:16266:0:(genops.c:885:class_export_put()) final put ffff94688414c800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789121040.352705:0:16266:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789121040.352790:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121040.352797:0:16266:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789121040.352802:0:16266:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9468c0874ed8) has no exports 00000020:00000080:1.0:1789121040.354147:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff94688414c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00010000:00010000:3.0:1789121040.434748:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789121040.446803:0:16266:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789121040.446946:0:16266:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789121040.446954:0:16266:0:(genops.c:885:class_export_put()) final put ffff9468b9997800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789121040.446961:0:16266:0:(genops.c:844:class_export_destroy()) destroying export ffff9468b9997800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789121040.446973:0:16266:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789121040.447663:0:16266:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9468b9994800 00000020:02000400:1.0:1789121040.447726:0:16266:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:2.0:1789121041.299856:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121041.299867:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121041.299870:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789121041.299874:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789121041.299953:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789121041.299976:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970685568:0@lo:400:kworker.0 00000400:00000100:2.0:1789121041.300034:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970685568 offset 0 length 224: 4 00010000:00010000:0.0:1789121041.495350:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121042.513921:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121043.090040:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121028/real 1789121028] req@ffff9468938ea1c0 x1876028970684672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789121043 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121043.090075:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468938ea1c0 x1876028970684672/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789121043 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789121043.090111:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783263000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789121043.090140:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789121043.090144:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970684672:0@lo:38:kworker.0 00000100:00080000:1.0:1789121043.091800:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789121043.091811:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121043.091814:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789121043.091817:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789121043.091873:0:37:0:(import.c:65:import_set_state_nolock()) ffff946783263000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121043.091880:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 478 00000100:00080000:1.0:1789121043.091886:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789121043.091892:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff946783263000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121043.091929:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946784b2ed00 x1876028970685696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789121043.092114:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970685824:0@lo:400:kworker.0 00000400:00000100:1.0:1789121043.092166:0:3645:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970685824 offset 0 length 224: 4 00000100:00100000:0.0:1789121043.092395:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970685696:0@lo:38:kworker.0 00000400:00000100:0.0:1789121043.092421:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970685696 offset 0 length 520: 4 00010000:00010000:2.0:1789121043.545777:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121044.563063:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789121044.637356:0:16468:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1789121044.652006:0:16468:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1789121044.652101:0:16468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121044.652115:0:16468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121044.652123:0:16468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121044.652131:0:16468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121044.652155:0:16468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789121044.652161:0:16468:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789121044.652189:0:16468:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789121044.652212:0:16468:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946784b2ed00 x1876028970685696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789121063 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121044.652235:0:16468:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789121044.652241:0:16468:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789121044.652247:0:16468:0:(import.c:65:import_set_state_nolock()) ffff946783263000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789121044.652267:0:16468:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789121044.652271:0:16468:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946784b2ed00 x1876028970685696/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789121063 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121044.652279:0:16468:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789121044.652283:0:16468:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00010000:00010000:2.0:1789121044.652731:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121044.652741:0:8449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121044.652749:0:8449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887083a00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121044.652754:0:8449:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121044.652765:0:8449:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121044.652772:0:8449:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121044.652779:0:8449:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789121044.652782:0:8449:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789121044.652785:0:8449:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789121044.652810:0:8449:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946893206000 00010000:00010000:2.0:1789121044.652814:0:8449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121044.652982:0:8449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887083a00/0xb74d2367a830f350 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f357 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121044.652995:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121044.652997:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121044.652999:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121044.653028:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970685696:0@lo:38:kworker.0 00000100:00080000:0.0:1789121044.658747:0:16468:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789121044.658767:0:16468:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9468938e9680 x1876028970684800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121044 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121044.659159:0:16468:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946784b2d2c0 x1876028970685056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121046 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121044.659178:0:16468:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946783c2d2c0 x1876028970685184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121049 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121044.659207:0:16468:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946783c2da40 x1876028970685440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121051 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121044.659216:0:16468:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946783c2cf00 x1876028970685568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121057 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121044.659235:0:16468:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946784b2d680 x1876028970685824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121059 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121044.659242:0:16468:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789121044.659249:0:16468:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789121044.659277:0:16468:0:(import.c:65:import_set_state_nolock()) ffff9467839f9800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789121044.659384:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970685824:0@lo:400:kworker.0 00000100:00100000:1.0:1789121044.659395:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970685568:0@lo:400:kworker.0 00000100:00100000:1.0:1789121044.659402:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970685056:0@lo:400:kworker.0 00000100:00100000:3.0:1789121044.660658:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970685440:0@lo:400:kworker.0 00000100:00100000:3.0:1789121044.660672:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970685184:0@lo:400:kworker.0 00000100:00100000:0.0:1789121044.660939:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876028970685952:0@lo:39:umount.0 00000400:00000100:0.0:1789121044.660997:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876028970685952 offset 0 length 224: 4 00000100:00100000:2.0:1789121044.661422:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3644:1876028970684800:0@lo:400:kworker.0 00010000:00010000:3.0:1789121045.587967:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121046.610125:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121047.635040:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789121048.466458:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789121048.466472:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1789121048.658455:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121049.682630:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121050.706605:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121050.834009:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121035/real 1789121035] req@ffff946783c2de00 x1876028970685312/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789121050 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121050.834044:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946783c2de00 x1876028970685312/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789121050 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789121050.834084:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946893206000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789121050.834116:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789121050.834122:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:03a1864a-46e4-4762-8a00-3ced97b06903:3643:1876028970685312:0@lo:250:kworker.0 00000100:00080000:1.0:1789121050.834210:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 03a1864a-46e4-4762-8a00-3ced97b06903->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789121050.834215:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789121050.834219:0:37:0:(import.c:65:import_set_state_nolock()) ffff946893206000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121050.834223:0:37:0:(import.c:510:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 486 00000100:00080000:1.0:1789121050.834262:0:37:0:(import.c:589:import_select_connection()) MGC192.168.202.132@tcp: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789121050.834270:0:37:0:(import.c:624:import_select_connection()) MGC192.168.202.132@tcp: import ffff946893206000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121050.834300:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946784b2d2c0 x1876028970686080/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789121050.834373:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:03a1864a-46e4-4762-8a00-3ced97b06903:3643:1876028970686080:0@lo:250:kworker.0 00000400:00000100:0.0:1789121050.834419:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876028970686080 offset 0 length 520: 4 00010000:00010000:3.0:1789121051.729974:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121052.755917:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121053.779032:0:8450:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121054.802652:0:6507:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121054.930452:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121044/real 1789121044] req@ffff9468938e8f00 x1876028970685952/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789121054 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121054.930490:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468938e8f00 x1876028970685952/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789121054 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789121054.930510:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9467839f9800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789121054.930530:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876028970685952:0@lo:39:umount.0 00000100:00080000:3.0:1789121054.930847:0:16468:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1789121054.930851:0:16468:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789121054.930856:0:16468:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789121054.932082:0:16468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121054.932103:0:16468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121054.932111:0:16468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121054.932139:0:16468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121054.932243:0:16468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121054.932253:0:16468:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121054.932262:0:16468:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121054.932268:0:16468:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121054.932274:0:16468:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121054.932306:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789121054.932315:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121054.932323:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946887082200 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121054.932328:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121054.932338:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121054.932346:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121054.932352:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789121054.932355:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1789121054.932370:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946893206000 00010000:00010000:1.0:1789121054.932374:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121054.932381:0:6506:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946887082200/0xb74d2367a830f35e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f365 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121054.932409:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121054.932413:0:6506:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121054.932419:0:6506:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3e00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121054.932422:0:6506:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121054.932430:0:6506:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121054.932436:0:6506:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121054.932442:0:6506:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789121054.932444:0:6506:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1789121054.932449:0:6506:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946893206000 00010000:00010000:1.0:1789121054.932451:0:6506:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121054.932459:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121054.932460:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121054.932462:0:6506:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121054.932557:0:16468:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789121054.932562:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a3e00/0xb74d2367a830f683 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f68a expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121054.932578:0:16468:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789121054.932584:0:16468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789121054.932587:0:16468:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789121054.932623:0:16468:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789121054.932630:0:16468:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789121054.932636:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789121054.932644:0:16468:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789121054.932650:0:16468:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9467821e9a48) has no exports 00000020:00080000:3.0:1789121054.933032:0:16468:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9467821e9a48) has no exports 00000020:01000000:3.0:1789121054.934972:0:16468:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946782bd5960 - data ffff9468ab3065e8/ffff946783c57000 00000020:01000000:3.0:1789121054.935212:0:16468:0:(lprocfs_status_server.c:345:lprocfs_free_client_stats()) stat ffff946782bd5480 - data ffff9468ab30ae58/ffff946783b5e400 00010000:00010000:2.0:1789121054.936151:0:8449:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1789121054.944002:0:16468:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789121054.962082:0:16468:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f1f2 00000020:00000080:2.0:1789121054.962893:0:16468:0:(genops.c:885:class_export_put()) final put ffff946783267800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789121054.963030:0:16468:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946782aee800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789121054.963035:0:16468:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946782aee800 2 00000020:01000004:2.0:1789121054.963040:0:16468:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff946782aee800 from lustre-OST0001 00000020:00000080:2.0:1789121054.963080:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121054.963250:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff946783267800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1789121054.963457:0:16468:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789121054.963462:0:16468:0:(genops.c:885:class_export_put()) final put ffff946783262800/lustre-OST0001_UUID 00000020:00000080:2.0:1789121054.963465:0:16468:0:(genops.c:844:class_export_destroy()) destroying export ffff946783262800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789121054.963665:0:16468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789121054.964318:0:16468:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 03a1864a-46e4-4762-8a00-3ced97b06903->MGS 00010000:00010000:2.0:1789121054.965030:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468a2f11600/0xb74d2367a830ef4b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830ef52 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121054.965066:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468a2f11600/0xb74d2367a830ef4b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830ef52 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121054.965074:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789121054.965078:0:16468:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789121054.965087:0:16468:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789121054.965172:0:16468:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946893206000 00010000:00010000:2.0:1789121054.965177:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468a2f11600/0xb74d2367a830ef4b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830ef52 expref: -99 pid: 7449 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121054.965210:0:16468:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c2049200/0xb74d2367a830f3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xb74d2367a830f3c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121054.965218:0:16468:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c2049200/0xb74d2367a830f3c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xb74d2367a830f3c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121054.965223:0:16468:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789121054.965226:0:16468:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789121054.965228:0:16468:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789121054.965241:0:16468:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff946893206000 00010000:00010000:2.0:1789121054.965245:0:16468:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c2049200/0xb74d2367a830f3c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xb74d2367a830f3c7 expref: -99 pid: 6515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789121054.965268:0:16468:0:(import.c:65:import_set_state_nolock()) ffff946893206000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789121054.965273:0:16468:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789121054.965276:0:16468:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789121054.965278:0:16468:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789121054.965285:0:16468:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789121054.965301:0:16468:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff946784b2d2c0 x1876028970686080/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789121070 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789121054.965329:0:16468:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789121054.965332:0:16468:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:0.0:1789121054.965548:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:03a1864a-46e4-4762-8a00-3ced97b06903:3643:1876028970686080:0@lo:250:kworker.0 10000000:01000000:2.0:1789121054.965752:0:16468:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789121054.965771:0:16468:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830ee48 00000020:00000080:2.0:1789121054.965781:0:16468:0:(genops.c:885:class_export_put()) final put ffff946893202800/03a1864a-46e4-4762-8a00-3ced97b06903 00000020:01000000:2.0:1789121054.965794:0:16468:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.132@tcp (flags='') 00000020:00000080:2.0:1789121054.965802:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789121054.965810:0:16468:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.132@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789121054.965815:0:16468:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9468ab900000) has no exports 10000000:01000000:1.0:1789121054.965865:0:6515:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1789121054.965908:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff946893202800/03a1864a-46e4-4762-8a00-3ced97b06903 for MGC192.168.202.132@tcp 10000000:01000000:2.0:1789121054.966463:0:16468:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.202.132@tcp: client import never connected 00000100:00080000:2.0:1789121054.966468:0:16468:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789121054.966471:0:16468:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789121054.966569:0:16468:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789121054.966572:0:16468:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789121054.966625:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789121054.966633:0:16468:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.132@tcp (uuid 03a1864a-46e4-4762-8a00-3ced97b06903) 00000020:00000080:0.0:1789121054.966637:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946893206000 for MGC192.168.202.132@tcp 00000020:01000000:2.0:1789121054.966642:0:16468:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789121054.966647:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121054.966648:0:8921:0:(genops.c:885:class_export_put()) final put ffff94689053b800/03a1864a-46e4-4762-8a00-3ced97b06903 00000020:00000080:2.0:1789121054.966653:0:16468:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00000080:0.0:1789121054.966653:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff94689053b800/03a1864a-46e4-4762-8a00-3ced97b06903 for MGC192.168.202.132@tcp 00000020:01000000:0.0:1789121054.966662:0:8921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.132@tcp (03a1864a-46e4-4762-8a00-3ced97b06903) 00000020:00080000:2.0:1789121054.966663:0:16468:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff946783265800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789121054.966671:0:16468:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9467821eb490) has exports, disconnecting them 00000020:00080000:2.0:1789121054.966677:0:16468:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff946783265800), last request at 1789120802 00000020:00000080:2.0:1789121054.966681:0:16468:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f21c 00000020:00080000:2.0:1789121054.967183:0:16468:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff946783265800): rc 0 00000020:00000080:2.0:1789121054.967199:0:16468:0:(genops.c:885:class_export_put()) final put ffff946783265800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789121054.967557:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff946783265800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789121054.971991:0:16468:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789121054.972003:0:16468:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789121054.972009:0:16468:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789121054.972036:0:16468:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789121054.972431:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121054.972446:0:16468:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789121054.972456:0:16468:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789121054.972462:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121054.972467:0:16468:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789121054.972488:0:16468:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9467839f8800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789121054.972496:0:16468:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff946782858000) has exports, disconnecting them 00000020:00080000:0.0:1789121054.972502:0:16468:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9467839f8800), last request at 1789120802 00000020:00000080:0.0:1789121054.972507:0:16468:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f231 00000020:00080000:0.0:1789121054.972530:0:16468:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9467839f8800): rc 0 00000020:00000080:0.0:1789121054.972538:0:16468:0:(genops.c:885:class_export_put()) final put ffff9467839f8800/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789121054.972894:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff946783263000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789121054.972904:0:8921:0:(genops.c:885:class_export_put()) final put ffff946783265000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789121054.972908:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff946783265000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789121054.972925:0:8921:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789121054.973261:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9467839f8800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789121054.975910:0:16468:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789121054.975924:0:16468:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789121054.975930:0:16468:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789121054.975942:0:16468:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789121054.975995:0:8921:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9467839f9800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1789121054.976170:0:8450:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1789121054.979916:0:6507:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789121054.980135:0:6506:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1789121054.983915:0:8449:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1789121054.985054:0:6502:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff946887d6b400:6502] 1 exiting: rc = 0 00000100:00100000:1.0:1789121054.988001:0:6501:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9468abbe9200:6501] 0 exiting: rc = 1 00000100:00100000:1.0:1789121054.988159:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.988564:0:10341:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9468c1bd4e00:10341] 4 exiting: rc = 0 00000100:00100000:1.0:1789121054.988655:0:6505:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff946891f29600:6505] 2 exiting: rc = 0 00000100:00100000:1.0:1789121054.988724:0:6503:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9468a0418c00:6503] 0 exiting: rc = 1 00000100:00100000:2.0:1789121054.989757:0:9525:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9467830de000:9525] 3 exiting: rc = 0 00000100:00100000:3.0:1789121054.989858:0:6504:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9468a0419200:6504] 1 exiting: rc = 0 00000100:00100000:1.0:1789121054.990027:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990040:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990047:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990053:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990060:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990067:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990074:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990080:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990088:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990095:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990102:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990108:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990114:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990121:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990128:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990135:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990141:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990148:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990154:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990176:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990183:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990201:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990211:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990217:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990222:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990228:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990238:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990244:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990254:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990260:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990270:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990277:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990283:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990289:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990295:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990300:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990305:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990310:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990316:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990321:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990327:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990333:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990354:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990360:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990366:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990371:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990377:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990382:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990388:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990392:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990397:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990403:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990408:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990413:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990428:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990434:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990445:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990452:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990460:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990467:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990483:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990490:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990498:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789121054.990504:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789121054.999850:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789121054.999867:0:16468:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789121054.999875:0:16468:0:(genops.c:885:class_export_put()) final put ffff9468c1cf2000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789121054.999881:0:16468:0:(genops.c:844:class_export_destroy()) destroying export ffff9468c1cf2000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789121054.999893:0:16468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789121055.000099:0:16468:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946782aee800 1 00000020:00000080:1.0:1789121055.000108:0:16468:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xb74d2367a830f1c1 00000020:00000080:1.0:1789121055.000116:0:16468:0:(genops.c:885:class_export_put()) final put ffff9467821dd800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789121055.000131:0:16468:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789121055.000147:0:8921:0:(genops.c:844:class_export_destroy()) destroying export ffff9467821dd800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789121055.000173:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789121055.000179:0:16468:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789121055.000184:0:16468:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff94678285ced8) has no exports 00000020:00000080:0.0:1789121055.113165:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121055.113197:0:16468:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789121055.113205:0:16468:0:(genops.c:885:class_export_put()) final put ffff946782aec000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789121055.113211:0:16468:0:(genops.c:844:class_export_destroy()) destroying export ffff946782aec000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789121055.113225:0:16468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789121055.114098:0:16468:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff946782aef000 00000020:01000000:0.0:1789121055.114129:0:16468:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789121055.114137:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789121055.114142:0:16468:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789121055.114147:0:16468:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff946882bf4ed8) has no exports 00000020:00000080:0.0:1789121055.114183:0:16468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789121055.114202:0:16468:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789121055.114207:0:16468:0:(genops.c:885:class_export_put()) final put ffff94688414a000/OSS_uuid 00000020:00000080:0.0:1789121055.114210:0:16468:0:(genops.c:844:class_export_destroy()) destroying export ffff94688414a000/OSS_uuid for OSS 00000020:01000000:0.0:1789121055.114216:0:16468:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1789121055.115926:0:6514:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1789121055.116208:0:8435:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9468913bba00:8435] 2 exiting: rc = 0 00000100:00100000:3.0:1789121055.116285:0:9116:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff94678282ec00:9116] 3 exiting: rc = 0 00000100:00100000:3.0:1789121055.116359:0:8433:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9468913bb400:8433] 0 exiting: rc = 1 00000100:00100000:3.0:1789121055.116548:0:8434:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9468913bae00:8434] 1 exiting: rc = 0 00000100:00100000:3.0:1789121055.116716:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116728:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116736:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116754:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116763:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116862:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116870:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116877:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116883:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116890:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116896:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116903:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116909:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116915:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116920:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116928:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116933:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116939:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116945:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116950:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116957:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116962:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116968:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116992:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.116998:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117004:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117009:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117015:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117021:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117027:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117033:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117040:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117046:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117053:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117060:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117066:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117071:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117076:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117868:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117884:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117891:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117897:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117903:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117909:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117914:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117920:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117926:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117933:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117939:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117945:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117951:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117958:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117964:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117969:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117975:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117981:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117988:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.117993:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.118011:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.118016:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.118021:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.118026:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.118031:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.118047:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.120039:0:8437:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff946883579000:8437] 1 exiting: rc = 0 00000100:00100000:0.0:1789121055.120044:0:14522:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9468c190e200:14522] 2 exiting: rc = 0 00000100:00100000:0.0:1789121055.120208:0:8436:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9468913bb800:8436] 0 exiting: rc = 1 00000100:00100000:3.0:1789121055.146350:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146567:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146582:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146588:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146594:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146600:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146605:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146611:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146617:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146624:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146631:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146638:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146644:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146651:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146657:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146663:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146671:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146677:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146684:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146691:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146696:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146702:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146708:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146714:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146720:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146726:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146732:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146739:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146767:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146772:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146778:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146784:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146790:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146796:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146802:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146808:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146814:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146844:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146852:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146857:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146863:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146869:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146875:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146883:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146888:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146894:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146899:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146904:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146911:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146916:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146922:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146927:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146932:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146937:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146943:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146949:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146953:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146959:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146964:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146969:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146974:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146979:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146985:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.146998:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.157005:0:8440:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff946883578400:8440] 2 exiting: rc = 0 00000100:00100000:2.0:1789121055.157541:0:8439:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9468c190fa00:8439] 1 exiting: rc = 0 00000100:00100000:3.0:1789121055.158932:0:8438:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9468abbe9c00:8438] 0 exiting: rc = 1 00000100:00100000:0.0:1789121055.159144:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159154:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159160:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159167:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159175:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159182:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159199:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159206:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159214:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159220:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159227:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159233:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159240:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159247:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159253:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159261:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159287:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159295:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159301:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159308:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159316:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159322:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159328:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159338:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159345:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159350:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159356:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159362:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159368:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159374:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159385:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159391:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159398:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159404:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.159410:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.160897:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.160936:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.160944:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.160952:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.160958:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161001:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161010:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161017:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161024:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161031:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161037:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161045:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161052:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161059:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161067:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161075:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161084:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161091:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161098:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161105:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161113:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161120:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161127:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161133:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161140:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161146:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161152:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161159:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.161175:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197393:0:8442:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9468abb2da00:8442] 1 exiting: rc = 0 00000100:00100000:0.0:1789121055.197664:0:8441:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9468abb2ce00:8441] 0 exiting: rc = 1 00000100:00100000:3.0:1789121055.197874:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197883:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197890:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197896:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197902:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197908:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197914:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197920:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197927:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197932:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197938:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197945:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197953:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197959:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197965:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197971:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197977:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197982:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197988:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.197994:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198001:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198007:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198013:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198019:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198025:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198031:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198036:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198043:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198049:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198055:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198061:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198068:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198094:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198100:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198106:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198113:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198119:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198126:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198131:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198138:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198149:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198156:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198163:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198169:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198175:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198181:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198199:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198206:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198212:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198217:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198221:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198236:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198242:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198248:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198254:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198260:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198265:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198271:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198278:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198284:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198290:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198295:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198300:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.198306:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789121055.199841:0:8443:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9468852f8400:8443] 0 exiting: rc = 1 00000100:00100000:0.0:1789121055.199959:0:8444:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9468afd61200:8444] 1 exiting: rc = 0 00000100:00100000:3.0:1789121055.201665:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201676:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201692:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201718:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201725:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201731:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201742:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201749:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201755:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201763:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201770:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201790:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201798:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201804:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.201812:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202205:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202220:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202236:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202244:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202251:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202259:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202265:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202272:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202295:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202303:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202310:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202317:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202325:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202330:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202336:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202343:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202350:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202355:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202361:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202377:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202399:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202409:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202416:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202431:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202439:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202447:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202454:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202462:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202469:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202480:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202490:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202498:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202521:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202529:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202538:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202547:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202554:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202561:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202568:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202576:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202582:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202589:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202595:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202602:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202624:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202633:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202640:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202648:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789121055.202667:0:16468:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1789121055.240715:0:16468:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789121077.564404:0:17234:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789121087.803694:0:17833:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789121087.803700:0:17833:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789121087.803702:0:17833:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789121087.803978:0:17833:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff946784ac0800 00000020:01000004:3.0:1789121087.803994:0:17833:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789121087.804017:0:17833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789121087.804029:0:17833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9468afc7ced8) 00000020:00000080:3.0:1789121087.804043:0:17833:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789121087.912900:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789121087.913757:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.914907:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.915402:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.915964:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.916239:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.916435:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.916707:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.917098:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.917288:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.917541:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.917738:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.918010:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.918343:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.918725:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.919059:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.919280:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.919474:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.920031:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.920265:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.920468:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.920758:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.921085:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.921279:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.921538:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.921738:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.921986:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.922220:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.922540:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.922722:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.923199:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.923547:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.924139:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789121087.924420:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1789121087.926164:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.929496:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.929936:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.930227:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1789121087.930700:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.931090:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789121087.931273:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789121087.931449:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1789121087.931750:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789121087.932121:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.932309:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.932540:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.932720:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1789121087.933778:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.935152:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.935342:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.936111:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.936302:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:0.0:1789121087.936806:0:17833:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:01000000:0.0:1789121087.937737:0:17833:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1789121087.938201:0:17833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1789121087.938210:0:17833:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:0.0:1789121087.938222:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a831049f 00000020:01000004:0.0:1789121087.938230:0:17833:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1789121087.938235:0:17833:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1789121087.938240:0:17833:0:(tgt_mount.c:101:server_register_mount()) register mount ffff946784ac0800 from MGS 00000020:01000004:0.0:1789121087.938244:0:17833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1789121087.938255:0:17833:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff946783ca1a48) 00000020:00000080:0.0:1789121087.938266:0:17833:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1789121087.938329:0:17833:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946784ac0800 from MGS, refs=2 00080000:01000000:0.0:1789121087.938333:0:17833:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789121087.938338:0:17833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a83104ad 00000100:00100000:0.0:1789121087.938429:0:17833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1789121087.938745:0:17833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1789121087.938752:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789121087.939427:0:17833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789121087.939434:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789121087.940319:0:17833:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789121087.940559:0:17833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789121087.940565:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789121087.941238:0:17833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789121087.941245:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789121087.942150:0:17833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1789121087.942402:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1789121087.943409:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121087.943413:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121087.943421:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121087.943729:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121087.943732:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121087.943734:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121087.944334:0:17833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1789121087.946091:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1789121087.950718:0:17833:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:1.0:1789121087.952355:0:17845:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789121087.952416:0:17833:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789121087.952489:0:17833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789121087.953407:0:17833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789121087.953794:0:17833:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789121087.954286:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789121087.954292:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789121087.957781:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789121087.957794:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789121087.959602:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789121087.959613:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789121087.965630:0:17833:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789121087.965655:0:17833:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.132@tcp' 00000020:01000004:0.0:1789121087.965657:0:17833:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789121087.965687:0:17833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.132@tcp (typ=mgc) 00000020:00000080:0.0:1789121087.965701:0:17833:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.132@tcp (ffff946783ca3490) 00000020:00000080:0.0:1789121087.965716:0:17833:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789121087.965801:0:17833:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946888742800@MGC192.168.202.132@tcp: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789121087.965997:0:17833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.132@tcp-0 is initialized 00000040:01000000:0.0:1789121087.966017:0:17833:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 1 is initialized 10000000:01000000:1.0:1789121087.966742:0:17851:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789121087.966805:0:17833:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.132@tcp (uuid 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee) 00000020:00000080:0.0:1789121087.966856:0:17833:0:(genops.c:1385:class_connect()) connect: client 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee, cookie 0xb74d2367a83104bb 00000100:00080000:0.0:1789121087.966867:0:17833:0:(import.c:510:import_select_connection()) MGC192.168.202.132@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789121087.966873:0:17833:0:(import.c:624:import_select_connection()) MGC192.168.202.132@tcp: import ffff946888742800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121087.966917:0:17833:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468938ebc00 x1876028970686208/t0(0) o250->MGC192.168.202.132@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789121087.966942:0:17833:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee->MGS 00000020:01000004:0.0:1789121087.966960:0:17833:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789121087.966979:0:17833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789121087.966990:0:17833:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff946783ca4ed8) 00000020:00000080:0.0:1789121087.966999:0:17833:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789121087.967144:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3643:1876028970686208:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789121087.967207:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121087.967276:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970686208 00000100:00100000:1.0:1789121087.967283:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970686208 00000100:00100000:1.0:1789121087.967310:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121087.967318:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3643:x1876028970686208:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789121087.967341:0:17847:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee@0@lo t0 exp 0000000000000000 cur 538 last 0 00000020:00000080:1.0:1789121087.967361:0:17847:0:(genops.c:1385:class_connect()) connect: client 057e0b0e-c04f-45aa-a41a-bc7b139fb1ee, cookie 0xb74d2367a83104c9 00000100:00080000:1.0:1789121087.967492:0:17847:0:(import.c:65:import_set_state_nolock()) ffff946784a60000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789121087.967541:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+5:3643:x1876028970686208:12345-0@lo:250:mount.lustre.0 Request processed in 222us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121087.967548:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121087.967590:0:3643:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.132@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789121087.967599:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.132@tcp: connect to target with instance 0 00000100:00080000:1.0:1789121087.967606:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.132@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789121087.967609:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789121087.967613:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946888742800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789121087.967615:0:3643:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789121087.967621:0:3643:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789121087.967626:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3643:1876028970686208:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1789121087.969618:0:17850:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:1.0:1789121087.994382:0:17833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789121087.994663:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1789121087.994669:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1789121087.997656:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1789121087.997677:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789121088.000529:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789121088.000545:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789121088.001770:0:17833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789121088.002354:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789121088.002360:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789121088.003644:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789121088.003656:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1789121088.094494:0:17833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789121088.094711:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1789121088.094718:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1789121088.097082:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1789121088.097096:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789121088.099463:0:17833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789121088.099645:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789121088.099651:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789121088.101845:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789121088.101859:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1789121088.102476:0:17833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789121088.102661:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1789121088.102666:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1789121088.109987:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789121088.110007:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789121088.119415:0:17833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789121088.119603:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789121088.119616:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789121088.130142:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789121088.130156:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789121088.191404:0:17833:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789121088.191603:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789121088.191609:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789121088.195772:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789121088.195787:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789121088.201350:0:17833:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789121088.201369:0:17833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789121088.206419:0:17833:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789121088.206447:0:17833:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1789121088.206454:0:17833:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789121088.206546:0:17833:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789121088.206597:0:17833:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.132@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789121088.206602:0:17833:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789121088.206603:0:17833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789121088.206605:0:17833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789121088.206606:0:17833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789121088.206607:0:17833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789121088.206608:0:17833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789121088.206610:0:17833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789121088.206611:0:17833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789121088.206613:0:17833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789121088.206614:0:17833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789121088.206616:0:17833:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789121088.206622:0:17833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789121088.206623:0:17833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789121088.206624:0:17833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789121088.206625:0:17833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789121088.206626:0:17833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789121088.206627:0:17833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789121088.206628:0:17833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789121088.206629:0:17833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789121088.206630:0:17833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789121088.206631:0:17833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789121088.206653:0:17833:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789121088.206671:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ebc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686336:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789121088.206734:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121088.206867:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff946781089600 going to sleep for 11 seconds 00000100:00100000:1.0:1789121088.207501:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970686336 00000100:00100000:1.0:1789121088.207509:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970686336 00000100:00100000:1.0:1789121088.207584:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789121088.207593:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+5:17833:x1876028970686336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789121088.207641:0:17849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789121088.207644:0:17849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789121088.207646:0:17849:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1789121088.208012:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789121088.210155:0:17849:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:1.0:1789121088.212362:0:17871:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789121088.212369:0:17871:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:1.0:1789121088.212373:0:17871:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789121088.212376:0:17871:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789121088.212620:0:17871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1789121088.212811:0:17849:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789121088.212852:0:17849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789121088.214490:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+5:17833:x1876028970686336:12345-0@lo:253:mount.lustre.0 Request processed in 6888us (7746us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121088.214521:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789121088.214665:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ebc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686336:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789121088.214680:0:17833:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789121088.214683:0:17833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789121088.214685:0:17833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789121088.214686:0:17833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121088.214687:0:17833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121088.214688:0:17833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121088.214690:0:17833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121088.214691:0:17833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789121088.214693:0:17833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789121088.214695:0:17833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121088.214696:0:17833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789121088.214720:0:17833:0:(tgt_mount.c:101:server_register_mount()) register mount ffff946784ac0800 from lustre-MDT0000 10000000:01000000:2.0:1789121088.214771:0:17833:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1789121088.214773:0:17833:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789121088.214777:0:17833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff946783ca3490 10000000:01000000:2.0:1789121088.214781:0:17833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789121088.214789:0:17833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff946783ca3490 from 1 10000000:01000000:2.0:1789121088.214793:0:17833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789121088.215418:0:17833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.215430:0:17833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.215441:0:17833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121088.215461:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789121088.215555:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121088.215628:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e138c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789121088.215672:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970686464 00000100:00100000:1.0:1789121088.215679:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970686464 00000100:00100000:1.0:1789121088.215724:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789121088.215734:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+5:17833:x1876028970686464:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121088.215748:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121088.215763:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c217de00/0xb74d2367a83104d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83104d0 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.215785:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217de00/0xb74d2367a83104d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83104d0 expref: 6 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.215796:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c217de00/0xb74d2367a83104d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83104d0 expref: 6 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.215804:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217de00, rc 0) 00000100:00100000:1.0:1789121088.215917:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+6:17833:x1876028970686464:12345-0@lo:101:mount.lustre.0 Request processed in 184us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121088.215936:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789121088.216172:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686464:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121088.216185:0:17833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.216201:0:17833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121088.216273:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686592:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121088.216299:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121088.216382:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e138c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789121088.216585:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970686592 00000100:00100000:0.0:1789121088.216590:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970686592 00000100:00100000:0.0:1789121088.216662:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789121088.216669:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+6:17833:x1876028970686592:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121088.217318:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686592:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789121088.217351:0:17833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789121088.217374:0:17833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.217386:0:17833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121088.217395:0:17833:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff946784ac0800 10000000:01000000:3.0:1789121088.217401:0:17833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789121088.217406:0:17833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff946784ac0800 10000000:01000000:3.0:1789121088.217408:0:17833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789121088.217412:0:17833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff946784ac0800 from 1 10000000:01000000:3.0:1789121088.217414:0:17833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789121088.217438:0:17833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.217446:0:17833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.217454:0:17833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121088.217479:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686720:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789121088.217705:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121088.217767:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e138c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121088.217805:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970686720 00000100:00100000:2.0:1789121088.217815:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970686720 00000100:00100000:0.0:1789121088.218003:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+7:17833:x1876028970686592:12345-0@lo:501:mount.lustre.0 Request processed in 1332us (1701us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789121088.218012:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121088.218214:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789121088.218222:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+6:17833:x1876028970686720:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121088.218233:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121088.218247:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a54600/0xb74d2367a83104e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83104de expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.218269:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a54600/0xb74d2367a83104e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83104de expref: 7 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.218279:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a54600/0xb74d2367a83104e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83104de expref: 7 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.218287:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54600, rc 0) 00000100:00100000:3.0:1789121088.218329:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+7:17833:x1876028970686720:12345-0@lo:101:mount.lustre.0 Request processed in 108us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121088.218335:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789121088.218401:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686720:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121088.218414:0:17833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121088.218433:0:17833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121088.218446:0:17833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789121088.218461:0:17833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121088.218468:0:17833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a54c00/0xb74d2367a83104de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104e5 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121088.218475:0:17833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789121088.218479:0:17833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789121088.218484:0:17833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff946784ac0800 10000000:01000000:0.0:1789121088.218487:0:17833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789121088.218491:0:17833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789121088.218493:0:17833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789121088.218511:0:17833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121088.218517:0:17833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121088.218525:0:17833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121088.218540:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686848:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789121088.218567:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121088.218689:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff946781089a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121088.218766:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970686848 00000100:00100000:1.0:1789121088.218771:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970686848 00000100:00100000:1.0:1789121088.218791:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789121088.218798:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+7:17833:x1876028970686848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121088.218805:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121088.218813:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c217d400/0xb74d2367a83104f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83104ec expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.218860:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217d400/0xb74d2367a83104f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83104ec expref: 8 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.218868:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c217d400/0xb74d2367a83104f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83104ec expref: 8 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.218886:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d400, rc 0) 00000100:00100000:1.0:1789121088.218915:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+8:17833:x1876028970686848:12345-0@lo:101:mount.lustre.0 Request processed in 116us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121088.218920:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789121088.219063:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686848:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121088.219073:0:17833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121088.219081:0:17833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121088.219133:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121088.219156:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121088.219180:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff946781089a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121088.219276:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970686976 00000100:00100000:1.0:1789121088.219281:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970686976 00000100:00100000:1.0:1789121088.219311:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789121088.219317:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+8:17833:x1876028970686976:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121088.219439:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+9:17833:x1876028970686976:12345-0@lo:501:mount.lustre.0 Request processed in 122us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121088.219446:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789121088.219504:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970686976:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121088.219529:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970687104:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121088.219570:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121088.219592:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff946781089a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121088.219634:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970687104 00000100:00100000:1.0:1789121088.219644:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970687104 00000100:00100000:1.0:1789121088.219661:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789121088.219667:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+9:17833:x1876028970687104:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121088.222428:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+9:17833:x1876028970687104:12345-0@lo:503:mount.lustre.0 Request processed in 2752us (2849us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121088.222439:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789121088.222544:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e9e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970687104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121088.222965:0:17872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17872:1876028970687232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789121088.222999:0:17872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121088.223032:0:17872:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afdfa780 going to sleep for 11 seconds 00000100:00100000:0.0:1789121088.223111:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970687232 00000100:00100000:0.0:1789121088.223116:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970687232 00000100:00100000:0.0:1789121088.223147:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789121088.223153:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+9:17872:x1876028970687232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789121088.223665:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+9:17872:x1876028970687232:12345-0@lo:502:llog_process_th.0 Request processed in 510us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121088.223673:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789121088.223769:0:17872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17872:1876028970687232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789121088.223788:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121088.223797:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121088.223799:0:17872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789121088.223803:0:17872:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789121088.223804:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789121088.223816:0:17872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff946782858000) 00000020:00000080:1.0:1789121088.223857:0:17872:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789121088.223863:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789121088.223941:0:17872:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789121088.223947:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310501 00000020:00000080:1.0:1789121088.224807:0:17872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789121088.224814:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121088.224841:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121088.224842:0:17872:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789121088.224845:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121088.224848:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121088.224849:0:17872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789121088.224851:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789121088.224860:0:17872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff94678285ced8) 00000020:00000080:1.0:1789121088.224883:0:17872:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789121088.224888:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789121088.224908:0:17872:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789121088.224911:0:17872:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789121088.224919:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789121088.224984:0:17872:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946784ac0800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789121088.224999:0:17872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff94678285b490) 00000020:00000080:1.0:1789121088.225008:0:17872:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789121088.225201:0:17872:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789121088.225208:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a8310516 00000020:00000080:1.0:1789121088.225301:0:17872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789121088.225307:0:17872:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789121088.225311:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xb74d2367a831051d 00080000:01000000:1.0:1789121088.225317:0:17872:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789121088.225320:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310524 00010000:00010000:3.0:1789121088.342664:0:17872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789121088.343599:0:17872:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:3.0:1789121088.343900:0:17872:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789121088.344557:0:17872:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9468afc79a48) 00000020:00000080:3.0:1789121088.344576:0:17872:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789121088.344664:0:17872:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789121088.344672:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310532 00000020:00000080:3.0:1789121088.345721:0:17872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789121088.354193:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xb74d2367a8310539 00000020:00000080:0.0:1789121088.354678:0:17872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789121088.354699:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121088.354705:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121088.354707:0:17872:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789121088.354710:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789121088.354713:0:17872:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1789121088.354715:0:17872:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789121088.354717:0:17872:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789121088.354718:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789121088.354721:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121088.354723:0:17872:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789121088.354725:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121088.354730:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121088.354731:0:17872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789121088.354736:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789121088.354774:0:17872:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1789121088.354792:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121088.354794:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121088.354796:0:17872:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1789121088.354798:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121088.354801:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121088.354802:0:17872:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1789121088.354805:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789121088.354811:0:17872:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:00000080:0.0:1789121088.354868:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789121088.354894:0:17872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff946783ca0000) 00000020:00000080:0.0:1789121088.354908:0:17872:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1789121088.354914:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789121088.354968:0:17872:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1789121088.354973:0:17872:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789121088.354981:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310547 00010000:00080000:0.0:1789121088.355013:0:17872:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946888741000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789121088.364638:0:17872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1789121088.366630:0:17872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789121088.366654:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1789121088.366695:0:17872:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789121088.366720:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a831054e 00000100:00080000:0.0:1789121088.366735:0:17872:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789121088.366740:0:17872:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff946888741000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121088.366779:0:17872:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468938ea580 x1876028970687360/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121088.366869:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970687360:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789121088.366960:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121088.367090:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970687360 00000100:00100000:3.0:1789121088.367098:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970687360 00000100:00100000:3.0:1789121088.367129:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789121088.367137:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876028970687360:12345-0@lo:38:llog_process_th.0 00010000:00020000:3.0:1789121088.367152:0:17859:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:0.0:1789121088.370057:0:17872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1789121088.370196:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121088.370203:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121088.370205:0:17872:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1789121088.370209:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789121088.370212:0:17872:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1789121088.370214:0:17872:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789121088.370215:0:17872:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789121088.370217:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789121088.370220:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121088.370221:0:17872:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789121088.370223:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789121088.370229:0:17872:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1789121088.370233:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121088.370234:0:17872:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789121088.370237:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789121088.370242:0:17872:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:0.0:1789121088.370267:0:17872:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789121088.370270:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789121088.370290:0:17872:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9467821eb490) 00000020:00000080:0.0:1789121088.370312:0:17872:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1789121088.370316:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789121088.370414:0:17872:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789121088.370421:0:17872:0:(osd_handler.c:8895:osd_obd_connect()) connect #6 00000020:00000080:0.0:1789121088.370433:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a831055c 00010000:00080000:0.0:1789121088.370476:0:17872:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468a08a2000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789121088.370704:0:17872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1789121088.372753:0:17872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789121088.373226:0:17872:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789121088.374893:0:17872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121088.375132:0:17872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1789121088.381992:0:17872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789121088.390788:0:17878:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789121088.390797:0:17878:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789121088.392174:0:17872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789121088.392189:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789121088.392231:0:17872:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789121088.392251:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a8310563 00000100:00080000:1.0:1789121088.392262:0:17872:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789121088.392269:0:17872:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9468a08a2000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121088.392324:0:17872:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946784b2da40 x1876028970687488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789121088.392347:0:17872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789121088.392420:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121088.392424:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121088.392426:0:17872:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789121088.392430:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789121088.392433:0:17872:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1789121088.392434:0:17872:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789121088.392436:0:17872:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789121088.392437:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789121088.392445:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121088.392447:0:17872:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789121088.392450:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789121088.392466:0:17872:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789121088.392470:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121088.392472:0:17872:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789121088.392475:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789121088.392478:0:17872:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:1.0:1789121088.392504:0:17872:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789121088.392507:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789121088.392519:0:17872:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff946782859a48) 00000020:00000080:1.0:1789121088.392531:0:17872:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1789121088.392535:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789121088.392590:0:17872:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789121088.392596:0:17872:0:(osd_handler.c:8895:osd_obd_connect()) connect #7 00000020:00000080:1.0:1789121088.392602:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xb74d2367a8310571 00010000:00080000:1.0:1789121088.392632:0:17872:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468a08a9800@lustre-OST0001-osc-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789121088.392851:0:17872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000100:00100000:0.0:1789121088.393282:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970687488:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789121088.393336:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970687488 offset 0 length 520: 4 00000040:01000000:1.0:1789121088.393547:0:17872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789121088.393565:0:17872:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789121088.398640:0:17872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121088.398917:0:17872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1789121088.399043:0:17872:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1789121088.399435:0:17880:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789121088.399440:0:17880:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000100:00100000:2.0:1789121088.399948:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876028970687360:12345-0@lo:38:llog_process_th.0 Request processed in 32805us (32982us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789121088.399966:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789121088.400070:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946888741000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789121088.400076:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789121088.400080:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970687360:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1789121088.400931:0:17872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789121088.400944:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789121088.400984:0:17872:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789121088.401004:0:17872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a8310578 00000100:00080000:1.0:1789121088.401012:0:17872:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789121088.401027:0:17872:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9468a08a9800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:1.0:1789121088.401063:0:17872:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946784b2d680 x1876028970687616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789121088.401088:0:17872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1789121088.401134:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121088.401143:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121088.401145:0:17872:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789121088.401149:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121088.401153:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121088.401155:0:17872:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789121088.401158:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789121088.401160:0:17872:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789121088.401162:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121088.401164:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121088.401165:0:17872:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789121088.401168:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121088.401170:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121088.401171:0:17872:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789121088.401175:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789121088.401204:0:17872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17872:1876028970687744:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789121088.401265:0:17872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121088.401299:0:17872:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121088.401388:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970687744 00000100:00100000:3.0:1789121088.401394:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970687744 00000100:00100000:3.0:1789121088.401443:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789121088.401452:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+9:17872:x1876028970687744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789121088.401576:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+9:17872:x1876028970687744:12345-0@lo:502:llog_process_th.0 Request processed in 124us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121088.401583:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789121088.402298:0:17872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2c3c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17872:1876028970687744:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789121088.402329:0:17872:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121088.402336:0:17872:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121088.402337:0:17872:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789121088.402341:0:17872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789121088.402397:0:17833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789121088.402419:0:17833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789121088.402436:0:17833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.402446:0:17833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e23e00/0xb74d2367a83104ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104f3 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121088.402467:0:17833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946784ac0800 from 1 10000000:01000000:1.0:1789121088.402480:0:17833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789121088.402516:0:17833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.402525:0:17833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.402534:0:17833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121088.402550:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970687872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789121088.402593:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121088.402618:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b336c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121088.402889:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970687872 00000100:00100000:3.0:1789121088.402895:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970687872 00000100:00100000:3.0:1789121088.402926:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789121088.402934:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+9:17833:x1876028970687872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121088.402945:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121088.402959:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55400/0xb74d2367a8310586 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831057f expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.402979:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55400/0xb74d2367a8310586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831057f expref: 10 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.402991:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55400/0xb74d2367a8310586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831057f expref: 10 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.402999:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55400, rc 0) 00000100:00100000:3.0:1789121088.403044:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+10:17833:x1876028970687872:12345-0@lo:101:mount.lustre.0 Request processed in 111us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121088.403057:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789121088.403234:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970687616:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789121088.403265:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970687616 offset 0 length 520: 4 00000100:00100000:1.0:1789121088.403649:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2c3c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970687872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121088.403666:0:17833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.403677:0:17833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121088.404428:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688000:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789121088.404585:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121088.404609:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e0e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121088.404698:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970688000 00000100:00100000:1.0:1789121088.404705:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970688000 00000100:00100000:1.0:1789121088.404755:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789121088.404765:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+10:17833:x1876028970688000:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1789121088.404787:0:17848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1789121088.404793:0:17848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1789121088.404903:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+10:17833:x1876028970688000:12345-0@lo:256:mount.lustre.0 Request processed in 138us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121088.404912:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789121088.405108:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688000:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789121088.405734:0:17833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789121088.405793:0:17833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121088.405812:0:17833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121088.405851:0:17833:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946784ac0800 from 1 10000000:01000000:0.0:1789121088.405855:0:17833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789121088.405895:0:17833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121088.405902:0:17833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121088.405911:0:17833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121088.405929:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789121088.405970:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121088.406015:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e0e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121088.406801:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970688128 00000100:00100000:1.0:1789121088.406809:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970688128 00000100:00100000:1.0:1789121088.406893:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789121088.406903:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+10:17833:x1876028970688128:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121088.406916:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121088.406933:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468c217d600/0xb74d2367a8310594 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831058d expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.406958:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217d600/0xb74d2367a8310594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831058d expref: 11 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.406970:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468c217d600/0xb74d2367a8310594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831058d expref: 11 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.406981:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d600, rc 0) 00000100:00100000:1.0:1789121088.407049:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:17833:x1876028970688128:12345-0@lo:101:mount.lustre.0 Request processed in 147us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121088.407056:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789121088.407366:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688128:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121088.407380:0:17833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121088.407388:0:17833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121088.407524:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688256:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121088.407558:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121088.407595:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e0e0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121088.407728:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970688256 00000100:00100000:1.0:1789121088.407733:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970688256 00000100:00100000:1.0:1789121088.407756:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789121088.407763:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:17833:x1876028970688256:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121088.407942:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:17833:x1876028970688256:12345-0@lo:501:mount.lustre.0 Request processed in 178us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121088.407949:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789121088.408034:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121088.408078:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688384:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121088.408115:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121088.408142:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9deed80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121088.408245:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970688384 00000100:00100000:1.0:1789121088.408249:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970688384 00000100:00100000:1.0:1789121088.408278:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789121088.408284:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:17833:x1876028970688384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121088.408361:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:17833:x1876028970688384:12345-0@lo:503:mount.lustre.0 Request processed in 77us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121088.408368:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789121088.408645:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688384:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121088.409117:0:17882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17882:1876028970688512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789121088.409164:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121088.409192:0:17882:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e0e0300 going to sleep for 11 seconds 00000100:00100000:1.0:1789121088.409256:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970688512 00000100:00100000:1.0:1789121088.409261:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970688512 00000100:00100000:1.0:1789121088.409295:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789121088.409302:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:17882:x1876028970688512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789121088.409904:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:17882:x1876028970688512:12345-0@lo:502:llog_process_th.0 Request processed in 601us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121088.409911:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789121088.410147:0:17882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17882:1876028970688512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789121088.410177:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121088.410187:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.410189:0:17882:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789121088.410196:0:17882:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946784ac0800 00000020:00000080:2.0:1789121088.410199:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121088.410207:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121088.410210:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.410211:0:17882:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789121088.410213:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121088.410216:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.410217:0:17882:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789121088.410221:0:17882:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff946784ac0800 00000020:00000080:2.0:1789121088.410223:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121088.410312:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121088.410316:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.410318:0:17882:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789121088.410328:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121088.410331:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.410332:0:17882:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121088.410336:0:17882:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946784ac0800 00000020:00000080:2.0:1789121088.410339:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121088.419447:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121088.419475:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.419478:0:17882:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121088.419482:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121088.419488:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.419489:0:17882:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121088.419496:0:17882:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946784ac0800 00000020:00000080:2.0:1789121088.419498:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121088.419555:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121088.419558:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.419559:0:17882:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121088.419562:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121088.419564:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.419565:0:17882:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789121088.419569:0:17882:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946784ac0800 00000020:00000080:2.0:1789121088.419572:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121088.419587:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121088.419590:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.419592:0:17882:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789121088.419594:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121088.419597:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.419598:0:17882:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789121088.419601:0:17882:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff946784ac0800 00000020:00000080:2.0:1789121088.419603:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789121088.419667:0:17882:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17882:1876028970688640:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121088.419752:0:17882:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121088.419800:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970688640 00000100:00100000:2.0:1789121088.419814:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970688640 00000100:00100000:2.0:1789121088.419891:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789121088.419900:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:17882:x1876028970688640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121088.420037:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:17882:x1876028970688640:12345-0@lo:502:llog_process_th.0 Request processed in 137us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121088.420045:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789121088.420096:0:17882:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9deed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121088.420117:0:17882:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17882:1876028970688640:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789121088.420145:0:17882:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121088.420150:0:17882:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121088.420151:0:17882:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789121088.420155:0:17882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 19 count 19 00000020:01000000:2.0:1789121088.420220:0:17833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:2.0:1789121088.420239:0:17833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789121088.420256:0:17833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.420268:0:17833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121088.420309:0:17833:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789121088.420312:0:17833:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff946784ac0800 10000000:01000000:2.0:1789121088.420315:0:17833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff946784ac0800 10000000:01000000:2.0:1789121088.420319:0:17833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789121088.420325:0:17833:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff946784ac0800 from 1 10000000:01000000:2.0:1789121088.420327:0:17833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789121088.420354:0:17833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.420372:0:17833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.420381:0:17833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121088.420396:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688768:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789121088.420426:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121088.420446:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9deed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121088.424904:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970688768 00000100:00100000:2.0:1789121088.424920:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970688768 00000100:00100000:2.0:1789121088.424983:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789121088.424993:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:17833:x1876028970688768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121088.425011:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121088.425109:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783c3aa00/0xb74d2367a83105a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831059b expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.425139:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783c3aa00/0xb74d2367a83105a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831059b expref: 12 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.425151:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783c3aa00/0xb74d2367a83105a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831059b expref: 12 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.425160:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3aa00, rc 0) 00000100:00100000:2.0:1789121088.425240:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17833:x1876028970688768:12345-0@lo:101:mount.lustre.0 Request processed in 248us (4813us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121088.425248:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789121088.425321:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688768:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121088.425341:0:17833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.425352:0:17833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121088.425433:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121088.425541:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121088.425572:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9deed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121088.425588:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970688896 00000100:00100000:2.0:1789121088.425592:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970688896 00000100:00100000:2.0:1789121088.425615:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121088.425620:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17833:x1876028970688896:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121088.425744:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17833:x1876028970688896:12345-0@lo:501:mount.lustre.0 Request processed in 123us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121088.425751:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121088.425782:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970688896:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121088.425808:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970689024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121088.425869:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121088.425899:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9deed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121088.425911:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970689024 00000100:00100000:2.0:1789121088.425914:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970689024 00000100:00100000:2.0:1789121088.425934:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121088.425939:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17833:x1876028970689024:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121088.426012:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17833:x1876028970689024:12345-0@lo:503:mount.lustre.0 Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121088.427588:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121088.427689:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970689024:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121088.427949:0:17884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17884:1876028970689152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121088.428008:0:17884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121088.430591:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970689152 00000100:00100000:2.0:1789121088.430603:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970689152 00000100:00100000:2.0:1789121088.431129:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789121088.431140:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17884:x1876028970689152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121088.431283:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17884:x1876028970689152:12345-0@lo:502:llog_process_th.0 Request processed in 145us (3274us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121088.431291:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789121088.431364:0:17884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0b93b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789121088.431386:0:17884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17884:1876028970689152:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789121088.431445:0:17884:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789121088.433304:0:17884:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff946783c7ced8) 00000020:00000080:2.0:1789121088.433336:0:17884:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1789121088.434986:0:17884:0:(tgt_mount.c:153:server_get_mount()) get mount ffff946784ac0800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789121088.434996:0:17884:0:(tgt_mount.c:187:server_put_mount()) put mount ffff946784ac0800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789121088.435000:0:17884:0:(obd_mount.c:710:lustre_put_lsi()) put ffff946784ac0800 4 00010000:00080000:2.0:1789121088.435114:0:17884:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946783de9800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789121088.445202:0:17884:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1789121088.455331:0:17884:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789121088.455377:0:17884:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789121088.455389:0:17884:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xb74d2367a83105b0 00000100:00080000:2.0:1789121088.455401:0:17884:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789121088.455407:0:17884:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff946783de9800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121088.455446:0:17884:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783c2e580 x1876028970689280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121088.455496:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970689280:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789121088.455561:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789121088.455616:0:17884:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789121088.455846:0:17884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17884:1876028970689408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121088.455898:0:17884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121088.455921:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970689408 00000100:00100000:2.0:1789121088.455926:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970689408 00000100:00100000:2.0:1789121088.455957:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789121088.455965:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17884:x1876028970689408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121088.456066:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17884:x1876028970689408:12345-0@lo:502:llog_process_th.0 Request processed in 101us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121088.456074:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789121088.456117:0:17884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9deed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121088.456137:0:17884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17884:1876028970689408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121088.456172:0:17884:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17884:1876028970689536:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121088.456198:0:17884:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121088.456214:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970689536 00000100:00100000:2.0:1789121088.456217:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970689536 00000100:00100000:2.0:1789121088.456233:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121088.456238:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17884:x1876028970689536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789121088.456286:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17884:x1876028970689536:12345-0@lo:502:llog_process_th.0 Request processed in 46us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121088.456300:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121088.456321:0:17884:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9deed80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121088.456331:0:17884:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17884:1876028970689536:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789121088.456346:0:17884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1789121088.456392:0:17833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789121088.456410:0:17833:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789121088.456423:0:17833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.456433:0:17833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783c3ae00/0xb74d2367a831059b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105a2 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789121088.456470:0:17833:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789121088.456472:0:17833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789121088.456473:0:17833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121088.456475:0:17833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121088.456476:0:17833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121088.456477:0:17833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121088.456478:0:17833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789121088.456480:0:17833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789121088.456482:0:17833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121088.456483:0:17833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789121088.456486:0:17833:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789121088.456489:0:17833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789121088.456490:0:17833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789121088.456491:0:17833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121088.456492:0:17833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121088.456493:0:17833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121088.456494:0:17833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121088.456495:0:17833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789121088.456496:0:17833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789121088.456497:0:17833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121088.456497:0:17833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789121088.456512:0:17833:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789121088.456520:0:17833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970689664:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789121088.456546:0:17833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121088.456557:0:17833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b9deee40 going to sleep for 11 seconds 00000100:00100000:2.0:1789121088.456575:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970689664 00000100:00100000:2.0:1789121088.456578:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970689664 00000100:00100000:2.0:1789121088.456595:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789121088.456600:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17833:x1876028970689664:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789121088.456617:0:17848:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789121088.456629:0:17848:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789121088.457086:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970689280 00000100:00100000:3.0:1789121088.457092:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970689280 00000100:00100000:3.0:1789121088.457112:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789121088.457117:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970689280:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789121088.457163:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970689280:12345-0@lo:38:llog_process_th.0 Request processed in 45us (1602us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789121088.457169:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789121088.457203:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789121088.457209:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783de9800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121088.457213:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789121088.457216:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970689280:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1789121088.466161:0:17848:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789121088.466184:0:17848:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789121088.466553:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17833:x1876028970689664:12345-0@lo:253:mount.lustre.0 Request processed in 9946us (10000us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121088.466566:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789121088.466633:0:17833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17833:1876028970689664:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789121088.466656:0:17833:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789121088.466660:0:17833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789121088.466661:0:17833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789121088.466663:0:17833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121088.466664:0:17833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121088.466665:0:17833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121088.466666:0:17833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121088.466668:0:17833:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789121088.466669:0:17833:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789121088.466671:0:17833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121088.466672:0:17833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789121088.466686:0:17833:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:1.0:1789121088.467237:0:17870:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789121088.467243:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789121088.467265:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.467280:0:17870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a55400/0xb74d2367a8310586 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831057f expref: 11 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.467287:0:17870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.467322:0:17870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a55400/0xb74d2367a8310586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a831057f expref: 11 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121088.467336:0:17870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946899a55400/0xb74d2367a8310586 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a831057f expref: 11 pid: 17849 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121088.467363:0:17870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2c3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970689792:0@lo:104: 00000100:00100000:1.0:1789121088.467401:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121088.467446:0:17870:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783b1c180 going to sleep for 11 seconds 00000100:00100000:3.0:1789121088.477910:0:17837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970689792 00000100:00100000:3.0:1789121088.477925:0:17837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970689792 00000100:00100000:3.0:1789121088.477979:0:17837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789121088.477990:0:17837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:17870:x1876028970689792:12345-0@lo:104: 00010000:00010000:3.0:1789121088.478009:0:17837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.478804:0:17837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789121088.478812:0:17837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:17870:x1876028970689792:12345-0@lo:104: Request processed in 823us (11410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121088.478834:0:17837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789121088.478894:0:17870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2c3c0 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970689792:0@lo:104: 00010000:00010000:3.0:1789121088.478918:0:17870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.484068:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121088.484076:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.484099:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d200 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121088.484103:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.484110:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121088.484116:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121088.484119:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789121088.484157:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.484161:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121088.484179:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.484186:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c217d200/0xb74d2367a831057f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310586 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121088.484204:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121088.484206:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121088.484208:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121088.484784:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970689920:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121088.485396:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121088.491732:0:17839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970689920 00000100:00100000:3.0:1789121088.491744:0:17839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970689920 00010000:00010000:3.0:1789121088.491781:0:17839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a55400/0xb74d2367a8310586 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831057f expref: 12 pid: 17849 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121088.491813:0:17839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789121088.491845:0:17839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:3646:x1876028970689920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121088.491860:0:17839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121088.491865:0:17839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a55400/0xb74d2367a8310586 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831057f expref: 12 pid: 17849 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.491887:0:17839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a55400/0xb74d2367a8310586 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a831057f expref: 12 pid: 17849 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.491904:0:17839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55400/0xb74d2367a8310586 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a831057f expref: 12 pid: 17849 timeout: 638 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.491917:0:17839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.491926:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789121088.491943:0:17839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024700313s 00010000:00010000:3.0:1789121088.491948:0:17839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.491954:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.491971:0:17839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.491976:0:17839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.491982:0:17839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217c000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121088.491987:0:17839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.491996:0:17839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.492014:0:17839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121088.492186:0:17870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121088.492197:0:17870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.492295:0:17839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217c000/0xb74d2367a83105b7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121088.492310:0:17839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121088.492398:0:17839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2e580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:3646:x1876028970689920:12345-0@lo:103:ldlm_bl.0 Request processed in 576us (7004us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121088.492406:0:17839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789121088.493610:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970689920:0@lo:103:ldlm_bl.0 00000020:00080000:2.0:1789121088.496590:0:17833:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789121088.496992:0:17833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789121088.497096:0:17894:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1789121088.497100:0:17894:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:0.0:1789121088.497593:0:17895:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1789121088.498038:0:17895:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789121088.499596:0:17833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:0.0:1789121088.501375:0:17895:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789121088.501458:0:17895:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:0.0:1789121088.517119:0:17896:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9468938e8b40 x1876028970690048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121088.517135:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00000040:01000000:3.0:1789121088.522207:0:17833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789121088.522256:0:17833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789121088.522807:0:17833:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789121088.522817:0:17833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789121088.522893:0:17833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789121088.525842:0:17833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789121088.528621:0:17833:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789121088.529900:0:17833:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789121088.541352:0:17833:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:2.0:1789121088.548299:0:17833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789121088.551968:0:17833:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789121088.552006:0:17833:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa04ac196b988 00100000:10000000:2.0:1789121088.552014:0:17833:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789121088.553618:0:17833:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789121088.553635:0:17833:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789121088.553790:0:17833:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789121088.553814:0:17833:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1789121088.554630:0:17833:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121088.557564:0:17833:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789121088.978391:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789121089.491608:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789121089.554664:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 10000000:01000000:2.0:1789121089.620088:0:17851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789121089.620097:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946784ac0800 from 7 10000000:01000000:2.0:1789121089.620102:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789121089.621360:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121089.621379:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121089.621391:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121089.621419:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970690176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789121089.621510:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121089.621579:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237600 going to sleep for 11 seconds 00000100:00100000:2.0:1789121089.621770:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970690176 00000100:00100000:2.0:1789121089.621787:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970690176 00000100:00100000:2.0:1789121089.621869:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789121089.621880:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+11:17851:x1876028970690176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121089.621895:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121089.621911:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783c3be00/0xb74d2367a83105c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83105be expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121089.621934:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783c3be00/0xb74d2367a83105c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83105be expref: 12 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121089.621945:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783c3be00/0xb74d2367a83105c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83105be expref: 12 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121089.621954:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3be00, rc 0) 00000100:00100000:2.0:1789121089.622025:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17851:x1876028970690176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121089.622031:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789121089.622119:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970690176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121089.622133:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121089.622143:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121089.622202:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970690304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789121089.622233:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121089.622263:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783237600 going to sleep for 11 seconds 00000100:00100000:2.0:1789121089.622320:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970690304 00000100:00100000:2.0:1789121089.622325:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970690304 00000100:00100000:2.0:1789121089.622355:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789121089.622362:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17851:x1876028970690304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789121089.622376:0:17848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789121089.622392:0:17848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789121089.622395:0:17848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789121089.622497:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:17851:x1876028970690304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121089.622504:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789121089.622646:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970690304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789121089.622691:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789121089.622696:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121089.622704:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121090.005325:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789121090.518716:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789121090.577908:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:2.0:1789121091.036251:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121091.606263:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:1.0:1789121092.049993:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121092.626369:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:2.0:1789121093.076756:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789121093.344338:0:18142:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1789121093.533802:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789121093.533863:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789121093.533867:0:36:0:(import.c:65:import_set_state_nolock()) ffff946888741000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121093.533875:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:3.0:1789121093.533880:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789121093.533886:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff946888741000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121093.533913:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf70c3c0 x1876028970690560/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789121093.533933:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121093.533937:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121093.533939:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121093.533942:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121093.533945:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789121093.533949:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789121093.533951:0:36:0:(import.c:65:import_set_state_nolock()) ffff946783de9800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121093.533956:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff946783de9800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121093.533968:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf70c780 x1876028970690688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121093.534002:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970690560:0@lo:38:kworker.0 00000100:00100000:3.0:1789121093.534090:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121093.534141:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970690688:0@lo:38:kworker.0 00000100:00100000:3.0:1789121093.534166:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121093.534291:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789121093.534303:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970690432:0@lo:400:kworker.0 00000100:00100000:0.0:1789121093.534339:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121093.534396:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970690560 00000100:00100000:0.0:1789121093.534403:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970690560 00000100:00100000:0.0:1789121093.534433:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789121093.534441:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970690560:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1789121093.534461:0:17860:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789121093.535198:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970690432 00000100:00100000:3.0:1789121093.535205:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970690432 00000100:00100000:3.0:1789121093.535292:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789121093.535313:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:3646:x1876028970690432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121093.535381:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:3646:x1876028970690432:12345-0@lo:400:kworker.0 Request processed in 70us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121093.535388:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789121093.542039:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970690688 00000100:00100000:1.0:1789121093.542054:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970690688 00000100:00100000:1.0:1789121093.542109:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789121093.542117:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876028970690688:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789121093.542150:0:17856:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 543 last 0 00000020:00000080:1.0:1789121093.542471:0:17856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xb74d2367a83105cc 00000004:00100000:1.0:1789121093.542490:0:17856:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789121093.542625:0:17856:0:(import.c:65:import_set_state_nolock()) ffff9468c1918000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789121093.542725:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3643:x1876028970690688:12345-0@lo:38:kworker.0 Request processed in 606us (8556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121093.542734:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789121093.549990:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970690432:0@lo:400:kworker.0 00010000:00080000:3.0:1789121093.550041:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9468bf70c780 x1876028970690688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789121093.550059:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789121093.550068:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789121093.550073:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789121093.550077:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783de9800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789121093.550084:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3643:1876028970690688:0@lo:38:kworker.0 00000100:00100000:0.0:1789121093.579121:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970690560:12345-0@lo:38:kworker.0 Request processed in 44672us (45025us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789121093.579151:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789121093.579180:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946888741000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121093.579187:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789121093.579192:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970690560:0@lo:38:kworker.0 00000100:00100000:1.0:1789121093.651105:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:1.0:1789121094.100073:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789121094.497277:0:18194:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121094.497524:0:18194:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789121094.675288:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:2.0:1789121095.122091:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789121095.420770:0:18244:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789121095.420985:0:18244:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1789121095.697886:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:2.0:1789121096.146104:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121096.721950:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:2.0:1789121097.170085:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121097.747455:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:1.0:1789121098.194804:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789121098.642234:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789121098.642241:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789121098.642245:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946888741000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121098.642253:0:8921:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 543 00000100:00080000:2.0:1789121098.642259:0:8921:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789121098.642267:0:8921:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff946888741000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121098.642292:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783c2e1c0 x1876028970690944/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121098.642325:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121098.642328:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121098.642331:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121098.642334:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789121098.642366:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121088/real 1789121088] req@ffff946784b2d680 x1876028970687616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121098 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121098.642389:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946784b2d680 x1876028970687616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121098 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121098.642398:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121088/real 1789121088] req@ffff946784b2da40 x1876028970687488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121098 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121098.642408:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff946784b2da40 x1876028970687488/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121098 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121098.642426:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970690944:0@lo:38:kworker.0 00000100:00100000:2.0:1789121098.642488:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789121098.642542:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789121098.642553:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789121098.642556:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970687616:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789121098.642561:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789121098.642565:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789121098.642568:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970687488:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1789121098.642601:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970690944 00000100:00100000:2.0:1789121098.642613:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970690944 00000100:00100000:2.0:1789121098.642650:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789121098.642657:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876028970690944:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1789121098.642675:0:17859:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789121098.644190:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970690816:0@lo:400:kworker.0 00000100:00100000:3.0:1789121098.644268:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121098.644323:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789121098.644330:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970691072:0@lo:400:kworker.0 00000100:00100000:3.0:1789121098.644358:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121098.644389:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970690816 00000100:00100000:3.0:1789121098.644395:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970690816 00000100:00100000:3.0:1789121098.644441:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789121098.644463:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:3644:x1876028970690816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121098.644515:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:3644:x1876028970690816:12345-0@lo:400:kworker.0 Request processed in 54us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121098.644523:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789121098.644565:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970691072 00000100:00100000:3.0:1789121098.644569:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970691072 00000100:00100000:3.0:1789121098.644592:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789121098.644599:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970691072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121098.644634:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970691072:12345-0@lo:400:kworker.0 Request processed in 35us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121098.644641:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789121098.644681:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946783c2cb40 x1876028970691072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121098.644698:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970691072:0@lo:400:kworker.0 00000100:00100000:3.0:1789121098.644789:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970690816:0@lo:400:kworker.0 00000100:00080000:0.0:1789121098.645055:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121098.645060:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789121098.645064:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a08a2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121098.645069:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:0.0:1789121098.645073:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789121098.645077:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9468a08a2000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121098.645105:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468938e8f00 x1876028970691200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789121098.645125:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121098.645129:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789121098.645130:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121098.645134:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:0.0:1789121098.645136:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789121098.645140:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9468a08a9800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121098.645151:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468938ea1c0 x1876028970691328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789121098.645192:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970691200:0@lo:8:kworker.0 00000400:00000100:0.0:1789121098.645222:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970691200 offset 0 length 520: 4 00000100:00100000:0.0:1789121098.645243:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970691328:0@lo:8:kworker.0 00000400:00000100:0.0:1789121098.645261:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970691328 offset 0 length 520: 4 00000100:00100000:2.0:1789121098.681346:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876028970690944:12345-0@lo:38:kworker.0 Request processed in 38679us (38849us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789121098.681363:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1789121098.682382:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946888741000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121098.682391:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789121098.682396:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970690944:0@lo:38:kworker.0 00000100:00100000:2.0:1789121098.769929:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:2.0:1789121099.218195:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121099.796056:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:2.0:1789121100.251263:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789121100.766204:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789121100.818904:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:3.0:1789121101.273163:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121101.842893:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:2.0:1789121102.291495:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121102.868185:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00000020:01000004:0.0:1789121102.970368:0:18589:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789121102.970372:0:18589:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1789121102.970374:0:18589:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1789121102.970513:0:18589:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9468b9c33800 00000020:01000004:0.0:1789121102.970528:0:18589:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1789121102.970541:0:18589:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789121102.970553:0:18589:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9467821e9a48) 00000020:00000080:0.0:1789121102.970567:0:18589:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1789121103.081643:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1789121103.082731:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1789121103.084576:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1789121103.085163:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1789121103.085448:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1789121103.085964:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1789121103.086496:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789121103.090706:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789121103.093922:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789121103.096119:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1789121103.096765:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1789121103.103595:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789121103.104223:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789121103.104657:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789121103.108545:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.109472:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.110004:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.110510:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.110980:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.111663:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.113557:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.114897:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.115622:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.115969:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.116190:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.116465:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.116757:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.117011:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.117215:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.117689:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.118245:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.118588:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.120079:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.120548:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.121187:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.121533:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.121866:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.122726:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.123157:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1789121103.123440:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.124001:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1789121103.124531:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789121103.126627:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789121103.127816:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789121103.132220:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789121103.133000:0:18589:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00080000:01000000:2.0:1789121103.144187:0:18589:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789121103.144494:0:18589:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1789121103.144511:0:18589:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789121103.144529:0:18589:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a83105da 00000020:01000004:2.0:1789121103.144538:0:18589:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789121103.144570:0:18589:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789121103.144575:0:18589:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789121103.144583:0:18589:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1789121103.144643:0:18589:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1789121103.144648:0:18589:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1789121103.155705:0:18589:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789121103.155798:0:18589:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.132@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1789121103.155804:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789121103.155806:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789121103.155807:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121103.155809:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121103.155810:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121103.155812:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121103.155814:0:18589:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789121103.155816:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121103.155817:0:18589:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789121103.155850:0:18589:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1789121103.155853:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789121103.155854:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789121103.155855:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121103.155857:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121103.155858:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121103.155859:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121103.155860:0:18589:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789121103.155862:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121103.155863:0:18589:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789121103.155916:0:18589:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1789121103.155945:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970691456:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789121103.156076:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121103.156231:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a09bf540 going to sleep for 11 seconds 00000100:00100000:3.0:1789121103.156695:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970691456 00000100:00100000:3.0:1789121103.156706:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970691456 00000100:00100000:3.0:1789121103.156904:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789121103.156917:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:18589:x1876028970691456:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789121103.156963:0:17849:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1789121103.156966:0:17849:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1789121103.156976:0:17849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1789121103.157552:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:18589:x1876028970691456:12345-0@lo:253:mount.lustre.0 Request processed in 635us (1474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121103.157561:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789121103.157655:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970691456:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789121103.157670:0:18589:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789121103.157673:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789121103.157675:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789121103.157676:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121103.157677:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121103.157679:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121103.157680:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121103.157681:0:18589:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789121103.158122:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121103.158125:0:18589:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789121103.158153:0:18589:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9468b9c33800 from lustre-MDT0001 10000000:01000000:2.0:1789121103.158199:0:18589:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1789121103.158204:0:18589:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789121103.158212:0:18589:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff946783ca3490 local copy 00010000:00010000:2.0:1789121103.158225:0:18589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121103.158360:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970691584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121103.158410:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121103.158462:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a09bf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121103.158561:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970691584 00000100:00100000:0.0:1789121103.158568:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970691584 00000100:00100000:0.0:1789121103.158662:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789121103.158673:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:18589:x1876028970691584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121103.158781:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:18589:x1876028970691584:12345-0@lo:501:mount.lustre.0 Request processed in 110us (370us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789121103.158789:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789121103.158954:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970691584:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789121103.158969:0:18589:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789121103.158989:0:18589:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789121103.158995:0:18589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.159006:0:18589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121103.159049:0:18589:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9468b9c33800 10000000:01000000:2.0:1789121103.159056:0:18589:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789121103.159063:0:18589:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff946783ca3490 10000000:01000000:2.0:1789121103.159065:0:18589:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789121103.159070:0:18589:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff946783ca3490 from 1 10000000:01000000:2.0:1789121103.159074:0:18589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789121103.159104:0:18589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3b800/0xb74d2367a83105e1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.159132:0:18589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783c3b800/0xb74d2367a83105e1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.159143:0:18589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783c3b800/0xb74d2367a83105e1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121103.159160:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970691712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789121103.159193:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121103.159617:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a09bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121103.159687:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970691712 00000100:00100000:3.0:1789121103.159693:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970691712 00000100:00100000:3.0:1789121103.159742:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789121103.159750:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+12:18589:x1876028970691712:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121103.160181:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121103.160206:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a54200/0xb74d2367a83105e8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83105e1 expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121103.160240:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a54200/0xb74d2367a83105e8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83105e1 expref: 13 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121103.160253:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a54200/0xb74d2367a83105e8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83105e1 expref: 13 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121103.160264:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54200, rc 0) 00000100:00100000:3.0:1789121103.160330:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+13:18589:x1876028970691712:12345-0@lo:101:mount.lustre.0 Request processed in 580us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121103.160337:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789121103.161227:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970691712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121103.161253:0:18589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783c3b800/0xb74d2367a83105e1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105e8 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.161265:0:18589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783c3b800/0xb74d2367a83105e1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83105e8 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121103.161290:0:18589:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789121103.161311:0:18589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3b800/0xb74d2367a83105e1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105e8 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.161319:0:18589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783c3b800/0xb74d2367a83105e1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105e8 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121103.161331:0:18589:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9468b9c33800 10000000:01000000:2.0:1789121103.161338:0:18589:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789121103.161343:0:18589:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9468b9c33800 from 1 10000000:01000000:2.0:1789121103.161346:0:18589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789121103.161397:0:18589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.161404:0:18589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.161412:0:18589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121103.161434:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970691840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789121103.161492:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121103.161534:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a09bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121103.161613:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970691840 00000100:00100000:3.0:1789121103.161628:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970691840 00000100:00100000:3.0:1789121103.161689:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789121103.161697:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+13:18589:x1876028970691840:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121103.161711:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121103.161724:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55400/0xb74d2367a83105f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83105ef expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121103.161769:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55400/0xb74d2367a83105f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83105ef expref: 14 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121103.161784:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55400/0xb74d2367a83105f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83105ef expref: 14 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121103.161793:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55400, rc 0) 00000100:00100000:3.0:1789121103.161970:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+14:18589:x1876028970691840:12345-0@lo:101:mount.lustre.0 Request processed in 273us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121103.161978:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789121103.166292:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970691840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121103.166336:0:18589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.166351:0:18589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121103.166378:0:18589:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789121103.166402:0:18589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.166410:0:18589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783c3a600/0xb74d2367a83105ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83105f6 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121103.166419:0:18589:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1789121103.166432:0:18589:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789121103.166440:0:18589:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9468b9c33800 10000000:01000000:2.0:1789121103.166464:0:18589:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789121103.166469:0:18589:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:2.0:1789121103.166472:0:18589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789121103.166518:0:18589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.166526:0:18589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.166535:0:18589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121103.166560:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970691968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789121103.166637:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121103.166689:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a09bf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121103.167425:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970691968 00000100:00100000:2.0:1789121103.167436:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970691968 00000100:00100000:2.0:1789121103.167499:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789121103.167509:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+14:18589:x1876028970691968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121103.167527:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121103.167544:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783c3b600/0xb74d2367a8310604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83105fd expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.167574:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783c3b600/0xb74d2367a8310604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83105fd expref: 15 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.167586:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783c3b600/0xb74d2367a8310604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83105fd expref: 15 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.167595:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3b600, rc 0) 00000100:00100000:2.0:1789121103.167670:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+15:18589:x1876028970691968:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121103.167678:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789121103.167746:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2da40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970691968:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121103.167768:0:18589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.167778:0:18589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789121103.171316:0:18589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:2.0:1789121103.173573:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789121103.181705:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789121103.181804:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:3.0:1789121103.182045:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:3.0:1789121103.182068:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:3.0:1789121103.182085:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:3.0:1789121103.182099:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:3.0:1789121103.182113:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:3.0:1789121103.182127:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:3.0:1789121103.182140:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:3.0:1789121103.182154:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:3.0:1789121103.182168:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:3.0:1789121103.182184:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:3.0:1789121103.182199:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:3.0:1789121103.182215:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:3.0:1789121103.182244:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:3.0:1789121103.182259:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:3.0:1789121103.182276:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:3.0:1789121103.182291:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:3.0:1789121103.182308:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:3.0:1789121103.182325:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:3.0:1789121103.182341:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:3.0:1789121103.182356:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:3.0:1789121103.182369:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:3.0:1789121103.182405:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:3.0:1789121103.182411:0:18589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:3.0:1789121103.182583:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970692096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121103.182686:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121103.182765:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121103.183287:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970692096 00000100:00100000:2.0:1789121103.183297:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970692096 00000100:00100000:2.0:1789121103.183361:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789121103.183373:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+15:18589:x1876028970692096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121103.183588:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+15:18589:x1876028970692096:12345-0@lo:501:mount.lustre.0 Request processed in 216us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121103.183598:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789121103.184075:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970692096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121103.184134:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970692224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789121103.184200:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121103.184289:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789121103.186050:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970692224 00000100:00100000:1.0:1789121103.186067:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970692224 00000100:00100000:1.0:1789121103.186169:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789121103.186183:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+15:18589:x1876028970692224:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121103.188710:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+15:18589:x1876028970692224:12345-0@lo:503:mount.lustre.0 Request processed in 2516us (4495us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121103.188727:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789121103.195554:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970692224:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789121103.196578:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789121103.196705:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970692352:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121103.198218:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121103.198328:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789121103.204263:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970692352 00000100:00100000:0.0:1789121103.204284:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970692352 00000100:00100000:0.0:1789121103.204416:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789121103.204429:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+15:18589:x1876028970692352:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121103.207544:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+15:18589:x1876028970692352:12345-0@lo:502:mount.lustre.0 Request processed in 3102us (9769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121103.207563:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789121103.207688:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970692352:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121103.208136:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789121103.208180:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:3.0:1789121103.208196:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:3.0:1789121103.208224:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:3.0:1789121103.208238:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:3.0:1789121103.208252:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:3.0:1789121103.208266:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:3.0:1789121103.208279:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:3.0:1789121103.208295:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:3.0:1789121103.208309:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:3.0:1789121103.208323:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:3.0:1789121103.208337:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:3.0:1789121103.208352:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:3.0:1789121103.208367:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:3.0:1789121103.208380:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:3.0:1789121103.208397:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:3.0:1789121103.208471:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:3.0:1789121103.208489:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:3.0:1789121103.208504:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:3.0:1789121103.208515:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:3.0:1789121103.208527:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:3.0:1789121103.208539:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:3.0:1789121103.208549:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:3.0:1789121103.208562:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:3.0:1789121103.208575:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:3.0:1789121103.208587:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:3.0:1789121103.208600:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:3.0:1789121103.208614:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:3.0:1789121103.208629:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:3.0:1789121103.208642:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:3.0:1789121103.208653:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:3.0:1789121103.208666:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:3.0:1789121103.208692:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:3.0:1789121103.208706:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:3.0:1789121103.208718:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:3.0:1789121103.208741:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:3.0:1789121103.208770:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:3.0:1789121103.208786:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:3.0:1789121103.208800:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:3.0:1789121103.208813:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:3.0:1789121103.208860:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:3.0:1789121103.208875:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:3.0:1789121103.208887:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:3.0:1789121103.208900:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:3.0:1789121103.208962:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970692480:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121103.209054:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121103.211646:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121103.211764:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970692480 00000100:00100000:2.0:1789121103.211776:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970692480 00000100:00100000:2.0:1789121103.211869:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789121103.211887:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+15:18589:x1876028970692480:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121103.212102:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+15:18589:x1876028970692480:12345-0@lo:502:mount.lustre.0 Request processed in 223us (3047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121103.212110:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789121103.212255:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970692480:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121103.212362:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:3.0:1789121103.212380:0:18589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1789121103.213699:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121103.213717:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121103.213719:0:18593:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789121103.213725:0:18593:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1789121103.213728:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789121103.219202:0:18593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9468afc78000) 00000020:00000080:3.0:1789121103.219247:0:18593:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1789121103.219280:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789121103.219441:0:18593:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789121103.219451:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a8310612 00000020:00000080:3.0:1789121103.219749:0:18593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1789121103.219813:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121103.220102:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121103.220105:0:18593:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1789121103.220111:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121103.220120:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121103.220121:0:18593:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1789121103.220133:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789121103.220146:0:18593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9468afc7b490) 00000020:00000080:3.0:1789121103.220160:0:18593:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1789121103.220165:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789121103.220167:0:18593:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1789121103.220171:0:18593:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1789121103.220178:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789121103.220243:0:18593:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468b9c33800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1789121103.220264:0:18593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9468ab900000) 00000020:00000080:3.0:1789121103.220275:0:18593:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1789121103.220362:0:18593:0:(lod_dev.c:2292:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789121103.220370:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a8310627 00000020:00000080:3.0:1789121103.220487:0:18593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1789121103.220494:0:18593:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789121103.220498:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xb74d2367a831062e 00080000:01000000:3.0:1789121103.220504:0:18593:0:(osd_handler.c:8895:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789121103.220508:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a8310635 00010000:00010000:3.0:1789121103.320058:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121103.337396:0:18593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789121103.338789:0:18593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1789121103.340025:0:18593:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789121103.341398:0:18593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1789121103.341411:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121103.341416:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121103.341419:0:18593:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1789121103.341422:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121103.341428:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121103.341429:0:18593:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1789121103.341432:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789121103.341438:0:18593:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:00000080:2.0:1789121103.341462:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789121103.341489:0:18593:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff946783c78000) 00000020:00000080:2.0:1789121103.341509:0:18593:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1789121103.341513:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789121103.341593:0:18593:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1789121103.341600:0:18593:0:(osd_handler.c:8895:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789121103.341606:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a8310643 00010000:00080000:2.0:1789121103.341634:0:18593:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946783dec000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:3.0:1789121103.352244:0:18593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1789121103.366219:0:18593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789121103.366241:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1789121103.366294:0:18593:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789121103.366320:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a831064a 00000100:00080000:3.0:1789121103.366332:0:18593:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789121103.366339:0:18593:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff946783dec000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121103.366382:0:18593:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf70d2c0 x1876028970692608/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789121103.366417:0:18593:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1789121103.366484:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121103.366489:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121103.366491:0:18593:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1789121103.366503:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789121103.366506:0:18593:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1789121103.366508:0:18593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789121103.366510:0:18593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789121103.366511:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789121103.366513:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121103.366514:0:18593:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789121103.366517:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121103.366521:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121103.366523:0:18593:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1789121103.366526:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00080000:1.0:1789121103.366533:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1789121103.366539:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1789121103.366542:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946888741000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789121103.366547:0:8921:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 548 00000100:00080000:1.0:1789121103.366552:0:8921:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789121103.366557:0:8921:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff946888741000 using connection 192.168.202.132@tcp/0@lo 00000004:01000000:3.0:1789121103.366560:0:18593:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789121103.366577:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00100000:1.0:1789121103.366578:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946784b2de00 x1876028970692736/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:00000080:3.0:1789121103.366582:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121103.366585:0:18593:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1789121103.366591:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789121103.366595:0:18593:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1789121103.366597:0:18593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789121103.366600:0:18593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00080000:1.0:1789121103.366601:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000000:3.0:1789121103.366602:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789121103.366606:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000100:00080000:1.0:1789121103.366608:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1789121103.366609:0:18593:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789121103.366615:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000100:00080000:1.0:1789121103.366616:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000020:01000004:3.0:1789121103.366619:0:18593:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000100:00080000:1.0:1789121103.366621:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:3.0:1789121103.366624:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121103.366627:0:18593:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789121103.366631:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789121103.366634:0:18593:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:3.0:1789121103.366660:0:18593:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1789121103.366663:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789121103.366685:0:18593:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9468ab901a48) 00000020:00000080:3.0:1789121103.366697:0:18593:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789121103.366704:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789121103.366778:0:18593:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1789121103.366785:0:18593:0:(osd_handler.c:8895:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789121103.366791:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a8310658 00010000:00080000:3.0:1789121103.366843:0:18593:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468bf672000@lustre-OST0000-osc-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:3.0:1789121103.367198:0:18593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1789121103.367753:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970692608:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789121103.367854:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121103.368139:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970692608 00000100:00100000:1.0:1789121103.368147:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970692608 00000100:00100000:1.0:1789121103.368182:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789121103.368197:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3643:x1876028970692608:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789121103.368223:0:17860:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000100:00100000:0.0:1789121103.368267:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970692736:0@lo:38:kworker.0 00000020:00000080:1.0:1789121103.368278:0:17860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a831065f 00000004:00100000:1.0:1789121103.368298:0:17860:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1789121103.368303:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:1.0:1789121103.368305:0:17860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000040:01000000:3.0:1789121103.369015:0:18593:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789121103.369789:0:18593:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:2.0:1789121103.371680:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970692864:0@lo:400:kworker.0 00000100:00100000:2.0:1789121103.371779:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121103.372032:0:17859:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789121103.372042:0:17859:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789121103.372145:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970692736 00000100:00100000:1.0:1789121103.372152:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970692736 00000100:00100000:1.0:1789121103.372814:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789121103.373315:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876028970692736:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1789121103.373420:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ea940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3643:x1876028970692736:12345-0@lo:38:kworker.0 Request processed in 107us (5116us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789121103.373427:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789121103.374337:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789121103.374348:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946888741000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789121103.374353:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789121103.374357:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970692736:0@lo:38:kworker.0 00000100:00100000:3.0:1789121103.374933:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970692864 00000100:00100000:3.0:1789121103.374942:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970692864 00000100:00100000:3.0:1789121103.375005:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789121103.375014:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970692864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121103.375104:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970692864:12345-0@lo:400:kworker.0 Request processed in 90us (3324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121103.375112:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789121103.376472:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946784b2f840 x1876028970692864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121103.376490:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970692864:0@lo:400:kworker.0 00000100:00080000:1.0:1789121103.376790:0:17860:0:(import.c:65:import_set_state_nolock()) ffff9468c081d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121103.380083:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e9680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3643:x1876028970692608:12345-0@lo:38:llog_process_th.0 Request processed in 11878us (12221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121103.380099:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789121103.380522:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789121103.380538:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789121103.380551:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789121103.380558:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789121103.380563:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783dec000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789121103.380590:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970692608:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789121103.380767:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970692992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121103.380989:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121103.381071:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970692992 00000100:00100000:1.0:1789121103.381080:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970692992 00000100:00100000:1.0:1789121103.381131:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789121103.381141:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1876028970692992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789121103.381178:0:17859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789121103.381239:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3647:x1876028970692992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121103.381246:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789121103.381382:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970692992:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1789121103.382416:0:18593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789121103.384365:0:18593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789121103.384548:0:18593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000040:00080000:2.0:1789121103.385062:0:18599:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789121103.385068:0:18599:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789121103.391511:0:18593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789121103.391530:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789121103.391587:0:18593:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789121103.391613:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a8310666 00000100:00080000:0.0:1789121103.391625:0:18593:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789121103.391631:0:18593:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9468bf672000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121103.392529:0:18593:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468938eb480 x1876028970693120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789121103.392557:0:18593:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1789121103.392672:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970693120:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789121103.392774:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970693120 offset 0 length 520: 4 00000020:01000000:0.0:1789121103.392777:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121103.392784:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.392787:0:18593:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789121103.392791:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789121103.392795:0:18593:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1789121103.392797:0:18593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789121103.392799:0:18593:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789121103.392801:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789121103.392804:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.392806:0:18593:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789121103.392818:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789121103.392842:0:18593:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1789121103.392848:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.392849:0:18593:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1789121103.392854:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789121103.392858:0:18593:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.132@tcp to nid 0x20000c0a8ca84 (192.168.202.132@tcp) 00000020:01000000:0.0:1789121103.392951:0:18593:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1789121103.392955:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789121103.392974:0:18593:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9467821eced8) 00000020:00000080:0.0:1789121103.392995:0:18593:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:0.0:1789121103.393002:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789121103.393096:0:18593:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:0.0:1789121103.393104:0:18593:0:(osd_handler.c:8895:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789121103.393115:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xb74d2367a8310674 00010000:00080000:0.0:1789121103.393153:0:18593:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946890f63000@lustre-OST0001-osc-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:0.0:1789121103.393382:0:18593:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:0.0:1789121103.393471:0:18593:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789121103.393489:0:18593:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:0.0:1789121103.398236:0:18593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121103.398759:0:18593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000100:00080000:2.0:1789121103.399101:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121103.399107:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121103.399111:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121103.399114:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:0.0:1789121103.399240:0:18593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1789121103.399645:0:18601:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789121103.399650:0:18601:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1789121103.408358:0:18593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789121103.408377:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789121103.408427:0:18593:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789121103.408455:0:18593:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a831067b 00000100:00080000:0.0:1789121103.408470:0:18593:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789121103.408478:0:18593:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff946890f63000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121103.408530:0:18593:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468938e92c0 x1876028970693248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789121103.408566:0:18593:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1789121103.408636:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121103.408640:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.408642:0:18593:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789121103.408645:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121103.408649:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.408650:0:18593:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789121103.408653:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789121103.408654:0:18593:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789121103.408656:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121103.408658:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.408660:0:18593:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789121103.408662:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121103.408674:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.408676:0:18593:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789121103.408680:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789121103.408713:0:18593:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121103.408715:0:18593:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.408716:0:18593:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789121103.408718:0:18593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000100:00100000:2.0:1789121103.408792:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970693248:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789121103.408885:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970693248 offset 0 length 520: 4 00000020:01000000:2.0:1789121103.408952:0:18589:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1789121103.408986:0:18589:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789121103.409000:0:18589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.409012:0:18589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783c3a800/0xb74d2367a83105fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310604 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121103.409032:0:18589:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9468b9c33800 from 1 10000000:01000000:2.0:1789121103.409035:0:18589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789121103.409063:0:18589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.409070:0:18589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.409081:0:18589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121103.409098:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970693376:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789121103.409138:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121103.409175:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468987370c0 going to sleep for 11 seconds 00000100:00080000:1.0:1789121103.409178:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121103.409184:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121103.409187:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121103.409190:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789121103.409196:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970693376 00000100:00100000:3.0:1789121103.409202:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970693376 00000100:00100000:3.0:1789121103.409257:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789121103.409267:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+15:18589:x1876028970693376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121103.409282:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121103.409297:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55600/0xb74d2367a8310689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310682 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121103.409325:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55600/0xb74d2367a8310689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310682 expref: 16 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121103.409336:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55600/0xb74d2367a8310689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310682 expref: 16 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121103.409345:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55600, rc 0) 00000100:00100000:3.0:1789121103.409407:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+16:18589:x1876028970693376:12345-0@lo:101:mount.lustre.0 Request processed in 140us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121103.409414:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789121103.409514:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970693376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121103.409528:0:18589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121103.409537:0:18589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121103.410139:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970693504:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1789121103.410184:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121103.410210:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468987370c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121103.410504:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970693504 00000100:00100000:3.0:1789121103.410509:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970693504 00000100:00100000:3.0:1789121103.410551:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789121103.410559:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+16:18589:x1876028970693504:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789121103.410576:0:17849:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789121103.410597:0:17849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789121103.410601:0:17849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1789121103.410706:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+16:18589:x1876028970693504:12345-0@lo:256:mount.lustre.0 Request processed in 147us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121103.410714:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789121103.411377:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970693504:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1789121103.412034:0:18589:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789121103.412050:0:18589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121103.412062:0:18589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121103.412072:0:18589:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468b9c33800 from 1 10000000:01000000:1.0:1789121103.412075:0:18589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789121103.412109:0:18589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121103.412117:0:18589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121103.412126:0:18589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121103.412145:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970693632:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789121103.412194:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121103.412235:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688357b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121103.412677:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970693632 00000100:00100000:0.0:1789121103.412684:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970693632 00000100:00100000:0.0:1789121103.412745:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789121103.412754:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+16:18589:x1876028970693632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121103.412767:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121103.412783:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e23400/0xb74d2367a8310697 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310690 expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.412806:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e23400/0xb74d2367a8310697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310690 expref: 17 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.412816:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e23400/0xb74d2367a8310697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310690 expref: 17 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.412870:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23400, rc 0) 00000100:00100000:0.0:1789121103.412916:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:18589:x1876028970693632:12345-0@lo:101:mount.lustre.0 Request processed in 163us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121103.412923:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789121103.413098:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970693632:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121103.413158:0:18589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121103.413166:0:18589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789121103.413307:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789121103.413341:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970693760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121103.413373:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121103.413403:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688357b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789121103.413506:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970693760 00000100:00100000:0.0:1789121103.413510:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970693760 00000100:00100000:0.0:1789121103.413544:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789121103.413551:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:18589:x1876028970693760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121103.413641:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:18589:x1876028970693760:12345-0@lo:501:mount.lustre.0 Request processed in 85us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121103.413648:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789121103.413672:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970693760:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121103.413697:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970693888:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121103.413747:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121103.413768:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688357b000 going to sleep for 11 seconds 00000100:00100000:2.0:1789121103.413813:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970693888 00000100:00100000:2.0:1789121103.413817:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970693888 00000100:00100000:2.0:1789121103.413870:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789121103.413886:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:18589:x1876028970693888:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121103.413967:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:18589:x1876028970693888:12345-0@lo:503:mount.lustre.0 Request processed in 82us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121103.413973:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789121103.413997:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970693888:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789121103.414385:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789121103.414447:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694016:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121103.414478:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121103.414501:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468987370c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121103.414542:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970694016 00000100:00100000:3.0:1789121103.414546:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970694016 00000100:00100000:3.0:1789121103.414570:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789121103.414575:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:18589:x1876028970694016:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121103.414642:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:18589:x1876028970694016:12345-0@lo:502:mount.lustre.0 Request processed in 67us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121103.414647:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789121103.414804:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694016:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121103.415043:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789121103.415069:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:0.0:1789121103.415084:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:0.0:1789121103.415096:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:0.0:1789121103.415106:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:0.0:1789121103.415118:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:0.0:1789121103.415130:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:0.0:1789121103.415143:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 144 off9680 00000040:00080000:0.0:1789121103.415156:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9904 00000040:00080000:0.0:1789121103.415169:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10128 00000040:00080000:0.0:1789121103.415183:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 144 off10272 00000040:00080000:0.0:1789121103.415197:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10496 00000040:00080000:0.0:1789121103.415210:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 224 off10720 00000040:00080000:0.0:1789121103.415223:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10848 00000040:00080000:0.0:1789121103.415239:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 224 off11072 00000040:00080000:0.0:1789121103.415266:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 224 off11296 00000040:00080000:0.0:1789121103.415282:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 128 off11424 00000100:00100000:0.0:1789121103.415309:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694144:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121103.415353:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121103.415426:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a600 going to sleep for 11 seconds 00000100:00100000:3.0:1789121103.425251:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970694144 00000100:00100000:3.0:1789121103.425267:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970694144 00000100:00100000:3.0:1789121103.425340:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789121103.425352:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:18589:x1876028970694144:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121103.425524:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:18589:x1876028970694144:12345-0@lo:502:mount.lustre.0 Request processed in 174us (10169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121103.425532:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789121103.425719:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789121103.425863:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11648 00000040:00080000:2.0:1789121103.425881:0:18589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:0.0:1789121103.430499:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121103.430515:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430518:0:18603:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789121103.430525:0:18603:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9468b9c33800 00000020:00000080:0.0:1789121103.430528:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121103.430537:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121103.430540:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430541:0:18603:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789121103.430544:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121103.430546:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430548:0:18603:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789121103.430551:0:18603:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9468b9c33800 00000020:00000080:0.0:1789121103.430553:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121103.430623:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121103.430627:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430629:0:18603:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789121103.430631:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121103.430634:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430635:0:18603:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121103.430638:0:18603:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468b9c33800 00000020:00000080:0.0:1789121103.430641:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121103.430658:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121103.430661:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430663:0:18603:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121103.430665:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121103.430667:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430668:0:18603:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121103.430688:0:18603:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468b9c33800 00000020:00000080:0.0:1789121103.430690:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121103.430719:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121103.430722:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430724:0:18603:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:0.0:1789121103.430726:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121103.430739:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430741:0:18603:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789121103.430745:0:18603:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468b9c33800 00000020:00000080:0.0:1789121103.430747:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121103.430763:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121103.430765:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430766:0:18603:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789121103.430768:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121103.430770:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430772:0:18603:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789121103.430774:0:18603:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468b9c33800 00000020:00000080:0.0:1789121103.430777:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789121103.430796:0:18603:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121103.430799:0:18603:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121103.430800:0:18603:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789121103.430803:0:18603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 19 count 19 00000020:01000000:1.0:1789121103.431443:0:18589:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:1.0:1789121103.431474:0:18589:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789121103.431494:0:18589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121103.431506:0:18589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121103.431562:0:18589:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789121103.431565:0:18589:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9468b9c33800 10000000:01000000:1.0:1789121103.431568:0:18589:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9468b9c33800 10000000:01000000:1.0:1789121103.431571:0:18589:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789121103.431582:0:18589:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9468b9c33800 from 1 10000000:01000000:1.0:1789121103.431585:0:18589:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789121103.431619:0:18589:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121103.431628:0:18589:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121103.431640:0:18589:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121103.431664:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694272:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789121103.431740:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121103.431787:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688357bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789121103.437407:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970694272 00000100:00100000:0.0:1789121103.437421:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970694272 00000100:00100000:0.0:1789121103.437482:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789121103.437492:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:18589:x1876028970694272:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121103.437509:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121103.437527:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e22200/0xb74d2367a83106a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831069e expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.437556:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e22200/0xb74d2367a83106a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831069e expref: 18 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.437574:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e22200/0xb74d2367a83106a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831069e expref: 18 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.437584:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22200, rc 0) 00000100:00100000:0.0:1789121103.437659:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970694272:12345-0@lo:101:mount.lustre.0 Request processed in 169us (5930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121103.437666:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789121103.437750:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121103.437770:0:18589:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.437779:0:18589:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789121103.443017:0:18589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789121103.448255:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121103.448527:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1789121103.448554:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1789121103.448568:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1789121103.448580:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1789121103.448593:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1789121103.448605:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1789121103.448618:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1789121103.448630:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1789121103.448644:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1789121103.448657:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1789121103.448670:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1789121103.448684:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1789121103.448710:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1789121103.448751:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1789121103.448770:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1789121103.448785:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1789121103.448797:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1789121103.448810:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1789121103.448874:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1789121103.448891:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1789121103.448906:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1789121103.448918:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1789121103.448931:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1789121103.448946:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1789121103.448962:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1789121103.448976:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1789121103.448989:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1789121103.449004:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1789121103.449026:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1789121103.449033:0:18589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789121103.449169:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121103.449238:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121103.449293:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789121103.451209:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970694400 00000100:00100000:1.0:1789121103.451221:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970694400 00000100:00100000:1.0:1789121103.451281:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789121103.451293:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970694400:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121103.451466:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970694400:12345-0@lo:501:mount.lustre.0 Request processed in 176us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121103.451473:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789121103.451493:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121103.451547:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121103.451596:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121103.451683:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff94678108a900 going to sleep for 11 seconds 00000100:00100000:1.0:1789121103.452438:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970694528 00000100:00100000:1.0:1789121103.452445:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970694528 00000100:00100000:1.0:1789121103.452520:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789121103.452529:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970694528:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121103.452642:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970694528:12345-0@lo:503:mount.lustre.0 Request processed in 114us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121103.452649:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789121103.452901:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694528:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789121103.453368:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789121103.453451:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121103.453508:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121103.453546:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff946882b9da80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121103.453609:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970694656 00000100:00100000:1.0:1789121103.453614:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970694656 00000100:00100000:1.0:1789121103.453685:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789121103.453693:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970694656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121103.453796:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970694656:12345-0@lo:502:mount.lustre.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121103.453803:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789121103.453886:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121103.454070:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:0.0:1789121103.454096:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:0.0:1789121103.454108:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:0.0:1789121103.454119:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:0.0:1789121103.454131:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:0.0:1789121103.454143:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:0.0:1789121103.454154:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:0.0:1789121103.454165:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:0.0:1789121103.454177:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:0.0:1789121103.454189:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:0.0:1789121103.454202:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:0.0:1789121103.454226:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:0.0:1789121103.454241:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:0.0:1789121103.454253:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:0.0:1789121103.454266:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:0.0:1789121103.454278:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:0.0:1789121103.454289:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:0.0:1789121103.454302:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:0.0:1789121103.454314:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:0.0:1789121103.454327:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:0.0:1789121103.454339:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:0.0:1789121103.454350:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:0.0:1789121103.454361:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:0.0:1789121103.454373:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:0.0:1789121103.454385:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:0.0:1789121103.454399:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:0.0:1789121103.454411:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:0.0:1789121103.454436:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:0.0:1789121103.454458:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:0.0:1789121103.454471:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:0.0:1789121103.454485:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:0.0:1789121103.454498:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:0.0:1789121103.454510:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:0.0:1789121103.454523:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:0.0:1789121103.454536:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:0.0:1789121103.454548:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:0.0:1789121103.454562:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:0.0:1789121103.454575:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:0.0:1789121103.454586:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:0.0:1789121103.454599:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:0.0:1789121103.454612:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:0.0:1789121103.454626:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:0.0:1789121103.454639:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:0.0:1789121103.454665:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:0.0:1789121103.454681:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:0.0:1789121103.454693:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:0.0:1789121103.454704:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:0.0:1789121103.454717:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:0.0:1789121103.454766:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121103.454850:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121103.454880:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff946882b9da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789121103.454902:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970694784 00000100:00100000:0.0:1789121103.454905:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970694784 00000100:00100000:0.0:1789121103.454933:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789121103.454940:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970694784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121103.455029:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970694784:12345-0@lo:502:mount.lustre.0 Request processed in 88us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121103.455035:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789121103.455094:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121103.455221:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:0.0:1789121103.455242:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:0.0:1789121103.455262:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121103.455296:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121103.455309:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff946882b9da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789121103.455323:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970694912 00000100:00100000:0.0:1789121103.455326:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970694912 00000100:00100000:0.0:1789121103.455344:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789121103.455350:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970694912:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121103.455416:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970694912:12345-0@lo:502:mount.lustre.0 Request processed in 65us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121103.455423:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789121103.455459:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970694912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121103.455492:0:18589:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:0.0:1789121103.455500:0:18589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1789121103.456415:0:18608:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:0.0:1789121103.456432:0:18608:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9467821e8000) 00000020:00000080:0.0:1789121103.456455:0:18608:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:0.0:1789121103.456557:0:18608:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468b9c33800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789121103.456563:0:18608:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468b9c33800 from lustre-MDT0001, refs=3 00000020:01000004:0.0:1789121103.456566:0:18608:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468b9c33800 3 00010000:00080000:0.0:1789121103.456601:0:18608:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468914ac800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789121103.462564:0:18608:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:0.0:1789121103.463185:0:18608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:0.0:1789121103.463239:0:18608:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789121103.463251:0:18608:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xb74d2367a83106b3 00000100:00080000:0.0:1789121103.463262:0:18608:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789121103.463273:0:18608:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9468914ac800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121103.463309:0:18608:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468938ea580 x1876028970695040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789121103.463345:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876028970695040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789121103.463416:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789121103.463474:0:18608:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789121103.475041:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970695040 00000100:00100000:1.0:1789121103.475059:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970695040 00000100:00100000:1.0:1789121103.475114:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789121103.475126:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876028970695040:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789121103.475165:0:17856:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 553 last 0 00000020:00000080:1.0:1789121103.475209:0:17856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xb74d2367a83106ba 00000004:00100000:1.0:1789121103.475233:0:17856:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789121103.475273:0:17856:0:(import.c:65:import_set_state_nolock()) ffff9468c0819800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789121103.475378:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e9e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3643:x1876028970695040:12345-0@lo:38:llog_process_th.0 Request processed in 253us (11961us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121103.475386:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789121103.475418:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121103.475423:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121103.475425:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121103.475429:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:1.0:1789121103.475616:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9468938ea580 x1876028970695040/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121103.475640:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789121103.475649:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:1.0:1789121103.475658:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789121103.475662:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789121103.475665:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468914ac800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789121103.475671:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3643:1876028970695040:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789121103.477726:0:18608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1789121103.478881:0:18589:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789121103.478934:0:18589:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789121103.478958:0:18589:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121103.478970:0:18589:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468c217cc00/0xb74d2367a831069e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106a5 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789121103.479025:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789121103.479028:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789121103.479029:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121103.479031:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121103.479032:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121103.479033:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121103.479034:0:18589:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789121103.479037:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121103.479038:0:18589:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789121103.479043:0:18589:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1789121103.479045:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789121103.479047:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1789121103.479048:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121103.479049:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121103.479050:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121103.479051:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121103.479052:0:18589:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789121103.479058:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121103.479059:0:18589:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789121103.479088:0:18589:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1789121103.479110:0:18589:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970695168:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789121103.479182:0:18589:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121103.479218:0:18589:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468c1b3a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121103.479670:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970695168 00000100:00100000:0.0:1789121103.479678:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970695168 00000100:00100000:0.0:1789121103.479727:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789121103.479749:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:18589:x1876028970695168:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789121103.479786:0:17849:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789121103.479801:0:17849:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789121103.496505:0:17834:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:0.0:1789121103.496548:0:17849:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789121103.496557:0:17849:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1789121103.496637:0:17870:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789121103.496642:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789121103.496663:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.496681:0:17870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946783c3be00/0xb74d2367a83105c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83105be expref: 18 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.496689:0:17870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a55600/0xb74d2367a8310689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310682 expref: 18 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.496696:0:17870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.496758:0:17870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a55600/0xb74d2367a8310689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310682 expref: 18 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.496776:0:17870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946899a55600/0xb74d2367a8310689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310682 expref: 18 pid: 17848 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121103.496793:0:17870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ebc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970695296:0@lo:104: 00000100:00100000:0.0:1789121103.496893:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789121103.496947:0:17870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946783c3be00/0xb74d2367a83105c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a83105be expref: 18 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.496956:0:17870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946783c3be00/0xb74d2367a83105c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a83105be expref: 18 pid: 17847 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121103.496964:0:17870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970695424:0@lo:104: 00000100:00100000:0.0:1789121103.496988:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121103.497006:0:17870:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789121103.497047:0:17838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970695296 00000100:00100000:0.0:1789121103.497053:0:17838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970695296 00000100:00100000:0.0:1789121103.497089:0:17838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970695424 00000100:00100000:0.0:1789121103.497092:0:17838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970695424 00000100:00100000:0.0:1789121103.497106:0:17838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789121103.497114:0:17838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+4:17870:x1876028970695296:12345-0@lo:104: 00010000:00010000:0.0:1789121103.497128:0:17838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497178:0:17838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789121103.497183:0:17838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ea580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+4:17870:x1876028970695296:12345-0@lo:104: Request processed in 70us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121103.497198:0:17838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789121103.497217:0:17838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789121103.497225:0:17838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:17870:x1876028970695424:12345-0@lo:104: 00010000:00010000:0.0:1789121103.497232:0:17838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497508:0:17838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789121103.497515:0:17838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:17870:x1876028970695424:12345-0@lo:104: Request processed in 291us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121103.497521:0:17838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789121103.497544:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121103.497551:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497557:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3ba00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121103.497561:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497571:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121103.497579:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121103.497585:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789121103.497617:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497624:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121103.497657:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497665:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783c3ba00/0xb74d2367a8310682 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310689 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497678:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121103.497682:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497688:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:0.0:1789121103.497691:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497698:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789121103.497704:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121103.497709:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789121103.497723:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497740:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789121103.497746:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497752:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946899a55000/0xb74d2367a83105be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83105c5 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.497776:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121103.497778:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121103.497780:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121103.497787:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121103.497808:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970695552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121103.497940:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121103.497975:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121103.497981:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970695680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121103.498004:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121103.498047:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970695552 00000100:00100000:0.0:1789121103.498052:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970695552 00010000:00010000:0.0:1789121103.498070:0:17840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a55600/0xb74d2367a8310689 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310682 expref: 19 pid: 17848 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121103.498092:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970695680 00000100:00100000:0.0:1789121103.498095:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970695680 00010000:00010000:0.0:1789121103.498105:0:17840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946783c3be00/0xb74d2367a83105c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a83105be expref: 20 pid: 17847 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121103.498117:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789121103.498122:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:3644:x1876028970695552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789121103.498134:0:17840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121103.498138:0:17840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a55600/0xb74d2367a8310689 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310682 expref: 20 pid: 17848 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498147:0:17840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a55600/0xb74d2367a8310689 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310682 expref: 20 pid: 17848 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498175:0:17840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121103.498203:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:3644:x1876028970695552:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121103.498210:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789121103.498224:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789121103.498229:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:3644:x1876028970695680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789121103.498237:0:17840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121103.498242:0:17840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946783c3be00/0xb74d2367a83105c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a83105be expref: 19 pid: 17847 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498250:0:17840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946783c3be00/0xb74d2367a83105c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a83105be expref: 19 pid: 17847 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498262:0:17840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498466:0:17840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789121103.498482:0:17840:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024700313s 00010000:00010000:0.0:1789121103.498487:0:17840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498494:0:17840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498502:0:17840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498517:0:17840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498523:0:17840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121103.498527:0:17840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498535:0:17840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498544:0:17840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498554:0:17840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121103.498580:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:3644:x1876028970695680:12345-0@lo:103:ldlm_bl.0 Request processed in 350us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121103.498587:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789121103.498643:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970695680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789121103.498652:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970695552:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789121103.498681:0:17870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55600/0xb74d2367a8310689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310682 expref: 18 pid: 17848 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121103.498691:0:17870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ebc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970695296:0@lo:104: 00010000:00010000:0.0:1789121103.498700:0:17870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783c3be00/0xb74d2367a83105c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a83105be expref: 17 pid: 17847 timeout: 653 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121103.498707:0:17870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ead00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970695424:0@lo:104: 00010000:00010000:0.0:1789121103.498742:0:17870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498752:0:17870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498758:0:17870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121103.498765:0:17870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e23a00/0xb74d2367a83106c1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121103.498847:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+16:18589:x1876028970695168:12345-0@lo:253:mount.lustre.0 Request processed in 19101us (19665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121103.498856:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789121103.503960:0:18589:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e940 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:18589:1876028970695168:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789121103.503979:0:18589:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1789121103.503983:0:18589:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789121103.503984:0:18589:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1789121103.503985:0:18589:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121103.503987:0:18589:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121103.503988:0:18589:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121103.503989:0:18589:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121103.503990:0:18589:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789121103.503992:0:18589:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121103.503993:0:18589:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789121103.504008:0:18589:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:1.0:1789121103.521066:0:18589:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:3.0:1789121103.521162:0:18617:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:3.0:1789121103.521166:0:18617:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1789121103.521907:0:18618:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789121103.522397:0:18589:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:3.0:1789121103.522580:0:18618:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789121103.524599:0:18619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18619:1876028970695808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789121103.524691:0:18619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:2.0:1789121103.524701:0:18589:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:2.0:1789121103.524723:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970695808 00000100:00100000:1.0:1789121103.524740:0:18619:0:(client.c:2715:ptlrpc_set_wait()) set ffff946890c11300 going to sleep for 11 seconds 00000100:00100000:2.0:1789121103.524741:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970695808 00000100:00100000:2.0:1789121103.524798:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789121103.524809:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18619:x1876028970695808:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789121103.524920:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:18619:x1876028970695808:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 112us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121103.524933:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:00080000:2.0:1789121103.524990:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789121103.525404:0:18619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18619:1876028970695808:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1789121103.525434:0:18619:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1789121103.525476:0:18619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18619:1876028970695936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789121103.525509:0:18619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121103.525530:0:18619:0:(client.c:2715:ptlrpc_set_wait()) set ffff946890c11600 going to sleep for 11 seconds 00000004:00000080:2.0:1789121103.525546:0:18589:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:2.0:1789121103.525560:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970695936 00000100:00100000:2.0:1789121103.525564:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970695936 00000100:00100000:2.0:1789121103.525590:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789121103.525597:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:18619:x1876028970695936:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1789121103.525709:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:18619:x1876028970695936:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 113us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121103.525716:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000040:01000000:2.0:1789121103.525749:0:18589:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789121103.525795:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789121103.526772:0:18589:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789121103.527369:0:18589:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789121103.527398:0:18589:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789121103.527494:0:18589:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789121103.528963:0:18618:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789121103.529038:0:18618:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000100:00100000:1.0:1789121103.529274:0:18619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18619:1876028970695936:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789121103.529378:0:18619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18619:1876028970696064:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789121103.529443:0:18619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121103.529494:0:17865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970696064 00000100:00100000:1.0:1789121103.529501:0:17865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970696064 00000100:00100000:1.0:1789121103.529546:0:17865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121103.529555:0:17865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18619:x1876028970696064:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789121103.529602:0:17865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:18619:x1876028970696064:12345-0@lo:900:lod0001_rec0000.0 Request processed in 47us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121103.529610:0:17865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121103.529647:0:18619:0:(client.c:2715:ptlrpc_set_wait()) set ffff946890c11600 going to sleep for 11 seconds 00010000:00080000:1.0:1789121103.529664:0:18619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff946784b2d2c0 x1876028970696064/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789121119 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121103.529677:0:18619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:18619:1876028970696064:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789121103.529723:0:18619:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18619:1876028970696192:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789121103.529768:0:18619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121103.529791:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970696192 00000100:00100000:1.0:1789121103.529795:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970696192 00000100:00100000:1.0:1789121103.529847:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789121103.529854:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18619:x1876028970696192:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789121103.529914:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:18619:x1876028970696192:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 60us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121103.529920:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789121103.529934:0:18619:0:(client.c:2715:ptlrpc_set_wait()) set ffff946890c11300 going to sleep for 11 seconds 00000100:00100000:1.0:1789121103.529945:0:18619:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:18619:1876028970696192:0@lo:1000:lod0001_rec0000.0 00000040:00080000:1.0:1789121103.529989:0:18619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789121103.530107:0:18589:0:(osd_handler.c:5551:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:1.0:1789121103.532012:0:18619:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789121103.532099:0:18619:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789121103.532103:0:18619:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1789121103.538965:0:18589:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1789121103.558750:0:18589:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789121103.558981:0:18589:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffa04ac19f3988 00100000:10000000:2.0:1789121103.558994:0:18589:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1789121103.560043:0:18589:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789121103.560098:0:18589:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789121103.560129:0:18589:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789121103.560172:0:18589:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1789121103.562603:0:18589:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121103.563162:0:18589:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789121103.891794:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:2.0:1789121104.350104:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121104.535226:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789121104.723670:0:17851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789121104.723680:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9468b9c33800 from 8 10000000:01000000:1.0:1789121104.723685:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789121104.723742:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121104.723754:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121104.723780:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121104.723806:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970696320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789121104.723908:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121104.723962:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030900 going to sleep for 11 seconds 00000100:00100000:3.0:1789121104.724018:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970696320 00000100:00100000:3.0:1789121104.724026:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970696320 00000100:00100000:3.0:1789121104.724771:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789121104.724783:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+16:17851:x1876028970696320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121104.724796:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121104.724812:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55200/0xb74d2367a83106cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83106c8 expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121104.724858:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55200/0xb74d2367a83106cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83106c8 expref: 17 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121104.724868:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55200/0xb74d2367a83106cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83106c8 expref: 17 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121104.724877:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55200, rc 0) 00000100:00100000:3.0:1789121104.724930:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:17851:x1876028970696320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121104.724937:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789121104.728895:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970696320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121104.728925:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121104.728938:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121104.729028:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970696448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789121104.729110:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121104.729157:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa421780 going to sleep for 11 seconds 00000100:00100000:1.0:1789121104.729294:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970696448 00000100:00100000:1.0:1789121104.729302:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970696448 00000100:00100000:1.0:1789121104.729356:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789121104.729366:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:17851:x1876028970696448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789121104.729391:0:17849:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789121104.729409:0:17849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789121104.729413:0:17849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:1.0:1789121104.730017:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:17851:x1876028970696448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 651us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121104.730026:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789121104.734749:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2c780 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970696448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789121104.734849:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789121104.734860:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121104.734872:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121104.734884:0:17851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789121104.734888:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946784ac0800 from 8 10000000:01000000:0.0:1789121104.734891:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789121104.734933:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121104.734940:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121104.734956:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121104.734975:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970696576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789121104.735038:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121104.735081:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946882b9d480 going to sleep for 11 seconds 00000100:00100000:0.0:1789121104.735101:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970696576 00000100:00100000:0.0:1789121104.735106:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970696576 00000100:00100000:0.0:1789121104.735150:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789121104.735159:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:17851:x1876028970696576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121104.735172:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121104.735185:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e23200/0xb74d2367a83106dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83106d6 expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121104.735208:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e23200/0xb74d2367a83106dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83106d6 expref: 18 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121104.735219:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e23200/0xb74d2367a83106dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83106d6 expref: 18 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121104.735227:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23200, rc 0) 00000100:00100000:0.0:1789121104.735272:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:17851:x1876028970696576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121104.735280:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789121104.735488:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970696576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121104.735502:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121104.735510:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121104.735857:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970696704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789121104.735952:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121104.735977:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783118d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789121104.736633:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970696704 00000100:00100000:0.0:1789121104.736641:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970696704 00000100:00100000:0.0:1789121104.736696:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789121104.736705:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:17851:x1876028970696704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789121104.736741:0:17848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789121104.736756:0:17848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789121104.736759:0:17848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789121104.736884:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:17851:x1876028970696704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 179us (931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121104.736892:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789121104.736966:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970696704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789121104.737019:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789121104.737027:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121104.737036:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121104.916632:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:3.0:1789121105.363254:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121105.554789:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789121105.940177:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:1.0:1789121106.386233:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121106.963316:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:3.0:1789121107.410773:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121107.986030:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 0 seconds 00010000:00010000:1.0:1789121108.434849:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789121108.883888:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789121108.883897:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789121108.883901:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946888741000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121108.883914:0:8921:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff946888741000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121108.883940:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf70f840 x1876028970696960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789121108.883956:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121108.883960:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121108.883962:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121108.883966:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121108.884003:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121108.884007:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789121108.884009:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121108.884012:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789121108.884047:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970697088:0@lo:400:kworker.0 00000100:00100000:3.0:1789121108.884121:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121108.884177:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789121108.884182:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970696832:0@lo:400:kworker.0 00000100:00100000:3.0:1789121108.884209:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121108.884243:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970696960:0@lo:38:kworker.0 00000100:00100000:3.0:1789121108.884269:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121108.884298:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970697216:0@lo:400:kworker.0 00000100:00100000:3.0:1789121108.884327:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121108.884343:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789121108.884348:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970697344:0@lo:400:kworker.0 00000100:00100000:3.0:1789121108.884371:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121108.884401:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970697088 00000100:00100000:3.0:1789121108.884409:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970697088 00000100:00100000:3.0:1789121108.884449:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970697344 00000100:00100000:3.0:1789121108.884452:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970697344 00000100:00100000:3.0:1789121108.884466:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789121108.884473:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970697088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121108.884530:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970697088:12345-0@lo:400:kworker.0 Request processed in 56us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121108.884537:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789121108.884563:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121108.884569:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970697344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121108.884601:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970697344:12345-0@lo:400:kworker.0 Request processed in 32us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121108.884606:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121108.884625:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970696832 00000100:00100000:1.0:1789121108.884891:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970696960 00000100:00100000:1.0:1789121108.884896:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970696960 00000100:00100000:1.0:1789121108.884917:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970697216 00000100:00100000:1.0:1789121108.884920:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970697216 00000100:00100000:1.0:1789121108.884937:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789121108.884943:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3643:x1876028970696960:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789121108.884968:0:17859:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 559 last 0 00000020:00000080:1.0:1789121108.885013:0:17859:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a83106e4 00000004:00100000:1.0:1789121108.885027:0:17859:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1789121108.885033:0:17859:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789121108.885751:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970696832 00000100:00100000:3.0:1789121108.885794:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789121108.885875:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:3647:x1876028970696832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121108.885949:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:3647:x1876028970696832:12345-0@lo:400:kworker.0 Request processed in 147us (1738us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121108.885956:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789121108.885999:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789121108.886006:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970697216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121108.886043:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970697216:12345-0@lo:400:kworker.0 Request processed in 37us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121108.886050:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789121108.886127:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468bf70e1c0 x1876028970697344/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121108.886143:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970697344:0@lo:400:kworker.0 00000100:00100000:3.0:1789121108.886157:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970697216:0@lo:400:kworker.0 00000100:00100000:3.0:1789121108.886191:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970696832:0@lo:400:kworker.0 00010000:00080000:3.0:1789121108.886204:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468bf70da40 x1876028970697088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121108.886225:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970697088:0@lo:400:kworker.0 00000100:00100000:1.0:1789121108.887024:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970697472:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789121108.887077:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121108.900049:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970697472 00000100:00100000:0.0:1789121108.900065:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970697472 00000100:00100000:0.0:1789121108.900126:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789121108.900138:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970697472:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789121108.901286:0:17860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789121108.901385:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970697472:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1248us (14305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121108.901397:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789121108.902044:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970697472:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789121108.904209:0:17859:0:(import.c:65:import_set_state_nolock()) ffff9468afd4b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121108.904308:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876028970696960:12345-0@lo:38:kworker.0 Request processed in 19363us (20036us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121108.904320:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1789121108.904461:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789121108.904472:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1789121108.904477:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1789121108.904480:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946888741000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789121108.904503:0:3643:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000674dfb5f): req@ffff9468938e8b40 x1876028970690048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121108.904528:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970696960:0@lo:38:kworker.0 00000100:00100000:2.0:1789121108.904843:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121108.904882:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688883e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789121108.904900:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970690048 00000100:00100000:2.0:1789121108.904906:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970690048 00000100:00100000:2.0:1789121108.904948:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789121108.904957:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17896:x1876028970690048:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789121108.905033:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17896:x1876028970690048:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121108.905040:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789121108.905072:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e8b40 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17896:1876028970690048:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1789121108.905112:0:17896:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789121108.905158:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17896:1876028970697728:0@lo:1000:lod0000_rec0001.0 00000100:00100000:3.0:1789121108.905297:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970697600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121108.905328:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121108.905366:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970697600 00000100:00100000:3.0:1789121108.905370:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970697600 00000100:00100000:3.0:1789121108.905395:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789121108.905401:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970697600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789121108.905424:0:17859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789121108.905462:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970697600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121108.905468:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789121108.905501:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970697600:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121108.911295:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121108.911338:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa421c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121108.911376:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970697728 00000100:00100000:2.0:1789121108.911385:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970697728 00000100:00100000:2.0:1789121108.911441:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789121108.911451:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17896:x1876028970697728:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789121108.911589:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17896:x1876028970697728:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 138us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121108.911597:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789121108.911638:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17896:1876028970697728:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789121108.911747:0:17896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17896:1876028970697856:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789121108.911772:0:17896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121108.911795:0:17896:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa421c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121108.911860:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970697856 00000100:00100000:2.0:1789121108.911865:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970697856 00000100:00100000:2.0:1789121108.911886:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789121108.911893:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17896:x1876028970697856:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789121108.911943:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17896:x1876028970697856:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121108.911950:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789121108.911976:0:17896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17896:1876028970697856:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789121108.912023:0:17896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789121108.921899:0:17896:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789121108.921993:0:17896:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:2.0:1789121108.921998:0:17896:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:02000400:0.0:1789121109.130057:0:18862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789121109.459450:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789121110.284691:0:18914:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789121110.287794:0:18914:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789121110.490396:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789121110.997975:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789121111.428416:0:18964:0:(tgt_mount.c:2344:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789121111.428768:0:18964:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789121111.506558:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121112.530228:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789121112.776617:0:19013:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0bab8f20 20000000:00000080:2.0:1789121112.776649:0:19013:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9468c1588c00 uarg=0000000000000000 20000000:01000000:2.0:1789121112.776710:0:19013:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789121112.776720:0:19013:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789121112.776726:0:19013:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789121112.777519:0:19014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 19 20000000:00000400:2.0:1789121112.777997:0:19013:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789121112.789301:0:19013:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789121112.789351:0:19013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121112.789378:0:19013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468c217d600/0xb74d2367a8310594 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831058d expref: 17 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121112.789386:0:19013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946783e23400/0xb74d2367a8310697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310690 expref: 17 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121112.789395:0:19013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121112.789457:0:19013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946783e23400/0xb74d2367a8310697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310690 expref: 17 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121112.789480:0:19013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946783e23400/0xb74d2367a8310697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310690 expref: 17 pid: 17849 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121112.789498:0:19013:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19013:1876028970697984:0@lo:104: 00000100:00100000:2.0:1789121112.790236:0:19013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789121112.790319:0:19013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468c217d600/0xb74d2367a8310594 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a831058d expref: 17 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121112.790332:0:19013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468c217d600/0xb74d2367a8310594 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a831058d expref: 17 pid: 17847 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121112.790362:0:19013:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19013:1876028970698112:0@lo:104: 00000100:00100000:2.0:1789121112.790389:0:19013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121112.790420:0:19013:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa4219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121112.790555:0:17837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970697984 00000100:00100000:3.0:1789121112.790565:0:17837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970697984 00000100:00100000:3.0:1789121112.790614:0:17837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970698112 00000100:00100000:3.0:1789121112.790617:0:17837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970698112 00000100:00100000:3.0:1789121112.790635:0:17837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121112.790655:0:17837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+4:19013:x1876028970697984:12345-0@lo:104: 00010000:00010000:3.0:1789121112.790672:0:17837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.790743:0:17837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789121112.790750:0:17837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+4:19013:x1876028970697984:12345-0@lo:104: Request processed in 106us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121112.790758:0:17837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121112.790779:0:17837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789121112.790786:0:17837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:19013:x1876028970698112:12345-0@lo:104: 00010000:00010000:3.0:1789121112.790809:0:17837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.790868:0:17837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789121112.790874:0:17837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:19013:x1876028970698112:12345-0@lo:104: Request processed in 88us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121112.790881:0:17837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789121112.790899:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789121112.790907:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.790915:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217c000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789121112.790920:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.790943:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789121112.790951:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121112.790958:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789121112.790994:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791002:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789121112.791026:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791035:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468c217c000/0xb74d2367a8310690 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310697 expref: -99 pid: 18589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791175:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121112.791180:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791187:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:3.0:1789121112.791190:0:17842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791197:0:17842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789121112.791204:0:17842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121112.791216:0:17842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789121112.791231:0:17842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791237:0:17842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789121112.791244:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791250:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783e22c00/0xb74d2367a831058d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310594 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791265:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121112.791267:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121112.791268:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121112.791278:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121112.791302:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970698240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121112.791340:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121112.791370:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789121112.791376:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970698368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121112.791398:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121112.791432:0:17839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970698240 00000100:00100000:3.0:1789121112.791437:0:17839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970698240 00010000:00010000:3.0:1789121112.791458:0:17839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946783e23400/0xb74d2367a8310697 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310690 expref: 18 pid: 17849 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121112.791482:0:17839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970698368 00000100:00100000:3.0:1789121112.791484:0:17839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970698368 00010000:00010000:3.0:1789121112.791494:0:17839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468c217d600/0xb74d2367a8310594 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831058d expref: 19 pid: 17847 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121112.791523:0:17839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121112.791530:0:17839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:3644:x1876028970698240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121112.791543:0:17839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121112.791549:0:17839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946783e23400/0xb74d2367a8310697 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310690 expref: 19 pid: 17849 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791560:0:17839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946783e23400/0xb74d2367a8310697 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310690 expref: 19 pid: 17849 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791582:0:17839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121112.791610:0:17839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:3644:x1876028970698240:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121112.791617:0:17839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121112.791630:0:17839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789121112.791636:0:17839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:3644:x1876028970698368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121112.791656:0:17839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121112.791660:0:17839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468c217d600/0xb74d2367a8310594 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831058d expref: 18 pid: 17847 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791669:0:17839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468c217d600/0xb74d2367a8310594 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a831058d expref: 18 pid: 17847 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791680:0:17839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791690:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791718:0:17839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791727:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791735:0:17839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791742:0:17839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791747:0:17839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3a200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121112.791751:0:17839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791760:0:17839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791769:0:17839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121112.791779:0:17839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121112.791801:0:17839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:3644:x1876028970698368:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121112.791809:0:17839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789121112.791884:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970698368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789121112.791894:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970698240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121112.792442:0:19013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e23400/0xb74d2367a8310697 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310690 expref: 17 pid: 17849 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121112.792459:0:19013:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2d2c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19013:1876028970697984:0@lo:104: 00010000:00010000:2.0:1789121112.792471:0:19013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468c217d600/0xb74d2367a8310594 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a831058d expref: 16 pid: 17847 timeout: 662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121112.792480:0:19013:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2fc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:19013:1876028970698112:0@lo:104: 00010000:00010000:2.0:1789121112.792503:0:19013:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121112.792513:0:19013:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121112.792519:0:19013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121112.792525:0:19013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783c3a200/0xb74d2367a83106eb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 19013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121113.554649:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789121114.002065:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121114.002074:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121114.002078:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121114.002090:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121114.002110:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121114.002114:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789121114.002117:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121114.002120:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789121114.002175:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970698880:0@lo:400:kworker.0 00000100:00100000:2.0:1789121114.002282:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121114.002335:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789121114.002341:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970698752:0@lo:400:kworker.0 00000100:00100000:2.0:1789121114.002368:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121114.002416:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970698880 00000100:00100000:2.0:1789121114.002424:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970698880 00000100:00100000:0.0:1789121114.002466:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970698752 00000100:00100000:0.0:1789121114.002472:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970698752 00000100:00100000:2.0:1789121114.002485:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789121114.002497:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970698880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121114.002505:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789121114.002513:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970698752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121114.002600:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970698624:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121114.002649:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970698880:12345-0@lo:400:kworker.0 Request processed in 154us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121114.002664:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789121114.002720:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946783c2ed00 x1876028970698880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121114.002736:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970698880:0@lo:400:kworker.0 00000100:00100000:0.0:1789121114.003714:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970698752:12345-0@lo:400:kworker.0 Request processed in 1190us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121114.003728:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789121114.004921:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970698752:0@lo:400:kworker.0 00000100:00100000:2.0:1789121114.004955:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789121114.004966:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970699264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121114.005055:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121114.005107:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121103/real 1789121103] req@ffff9468938e92c0 x1876028970693248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121113 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121114.005124:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468938e92c0 x1876028970693248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121113 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121114.005136:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121103/real 1789121103] req@ffff9468938eb480 x1876028970693120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121113 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121114.005148:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468938eb480 x1876028970693120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121113 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121114.005170:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121098/real 1789121098] req@ffff9468938e8f00 x1876028970691200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121113 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121114.005186:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468938e8f00 x1876028970691200/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121113 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121114.005196:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121098/real 1789121098] req@ffff9468938ea1c0 x1876028970691328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121113 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121114.005207:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468938ea1c0 x1876028970691328/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121113 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789121114.005221:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789121114.005240:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789121114.005244:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970693248:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789121114.005250:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468bf672000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789121114.005255:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789121114.005268:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970693120:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789121114.005272:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789121114.005277:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789121114.005280:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970691200:0@lo:8:kworker.0 00000100:00080000:2.0:1789121114.005284:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789121114.005288:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789121114.005290:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938ea1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970691328:0@lo:8:kworker.0 00000100:00100000:2.0:1789121114.005339:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970699264 00000100:00100000:2.0:1789121114.005347:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970699264 00000100:00100000:2.0:1789121114.005403:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789121114.005414:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970699264:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789121114.005464:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1789121114.005526:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970699264:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121114.005534:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789121114.005563:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121114.005568:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789121114.005571:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a08a2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121114.005577:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 548 00000100:00080000:2.0:1789121114.005582:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789121114.005586:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9468a08a2000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121114.005613:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf75c780 x1876028970699392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121114.005627:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121114.005659:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789121114.005662:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121114.005666:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 548 00000100:00080000:2.0:1789121114.005669:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1789121114.005673:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9468a08a9800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121114.005688:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf75ed00 x1876028970699520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121114.005698:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121114.005701:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789121114.005703:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468bf672000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121114.005706:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:2.0:1789121114.005709:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789121114.005712:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9468bf672000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121114.005724:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf75da40 x1876028970699648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789121114.005732:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789121114.005735:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789121114.005736:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789121114.005740:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 553 00000100:00080000:2.0:1789121114.005742:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789121114.005745:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff946890f63000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121114.005755:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf75e1c0 x1876028970699776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121114.005798:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970699264:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121114.005850:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970699392:0@lo:8:kworker.0 00000400:00000100:2.0:1789121114.005882:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970699392 offset 0 length 520: 4 00000100:00100000:2.0:1789121114.005914:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970699520:0@lo:8:kworker.0 00000400:00000100:2.0:1789121114.005934:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970699520 offset 0 length 520: 4 00000100:00100000:2.0:1789121114.005946:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970699648:0@lo:8:kworker.0 00000400:00000100:2.0:1789121114.005960:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970699648 offset 0 length 520: 4 00000100:00100000:2.0:1789121114.005969:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970699776:0@lo:8:kworker.0 00000400:00000100:2.0:1789121114.005986:0:3643:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876028970699776 offset 0 length 520: 4 00000100:00100000:2.0:1789121114.007431:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970698496:0@lo:400:kworker.0 00000100:00100000:2.0:1789121114.007529:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121114.008236:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970699008:0@lo:400:kworker.0 00000100:00100000:2.0:1789121114.008292:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121114.008351:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970699008 00000100:00100000:2.0:1789121114.008359:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970699008 00000100:00100000:2.0:1789121114.008415:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121114.008425:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970699008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121114.008490:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970699008:12345-0@lo:400:kworker.0 Request processed in 66us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121114.008499:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121114.008545:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970699008:0@lo:400:kworker.0 00000100:00100000:3.0:1789121114.009419:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121114.009467:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970699136:0@lo:400:kworker.0 00000100:00100000:3.0:1789121114.009499:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121114.009541:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970699136 00000100:00100000:3.0:1789121114.009547:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970699136 00000100:00100000:3.0:1789121114.009592:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789121114.009600:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970699136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121114.009731:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970699136:12345-0@lo:400:kworker.0 Request processed in 130us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121114.009740:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789121114.009786:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468bf75fc00 x1876028970699136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121130 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121114.009802:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970699136:0@lo:400:kworker.0 00000100:00100000:2.0:1789121114.010159:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970698624 00000100:00100000:2.0:1789121114.010165:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970698624 00000100:00100000:2.0:1789121114.010211:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121114.010219:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970698624:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121114.010517:0:17860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789121114.010579:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970698624:12345-0@lo:41:osp-pre-1-0.0 Request processed in 361us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121114.010587:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789121114.014372:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970698624:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121114.015144:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970698496 00000100:00100000:0.0:1789121114.015169:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970698496 00000100:00100000:0.0:1789121114.015243:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789121114.015268:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+16:3646:x1876028970698496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121114.015409:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+16:3646:x1876028970698496:12345-0@lo:400:kworker.0 Request processed in 142us (7880us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121114.015418:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789121114.015609:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970698496:0@lo:400:kworker.0 10000000:01000000:1.0:1789121114.145972:0:17851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789121114.145983:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468b9c33800 from 19 10000000:01000000:1.0:1789121114.145990:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789121114.146236:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121114.146250:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121114.146264:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121114.146300:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970699904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789121114.146473:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121114.146590:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789121114.149460:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970699904 00000100:00100000:3.0:1789121114.149483:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970699904 00000100:00100000:2.0:1789121114.149644:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789121114.149664:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+16:17851:x1876028970699904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121114.149687:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121114.149711:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783c3a200/0xb74d2367a83106f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83106f2 expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121114.149743:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783c3a200/0xb74d2367a83106f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83106f2 expref: 17 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121114.149754:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783c3a200/0xb74d2367a83106f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83106f2 expref: 17 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121114.149765:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3a200, rc 0) 00000100:00100000:2.0:1789121114.149896:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:17851:x1876028970699904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (3424us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121114.149904:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789121114.149975:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970699904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121114.149997:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121114.150008:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121114.150133:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970700032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121114.150187:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121114.150225:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa4219c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121114.150240:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970700032 00000100:00100000:2.0:1789121114.150244:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970700032 00000100:00100000:2.0:1789121114.150266:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789121114.150272:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:17851:x1876028970700032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121114.150409:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:17851:x1876028970700032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121114.150416:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789121114.150446:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970700032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121114.150497:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970700160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789121114.150538:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121114.150551:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa4219c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121114.150561:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970700160 00000100:00100000:2.0:1789121114.150563:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970700160 00000100:00100000:2.0:1789121114.150580:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789121114.150585:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:17851:x1876028970700160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789121114.150674:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:17851:x1876028970700160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121114.150681:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789121114.150730:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970700160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789121114.166294:0:19066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789121114.166637:0:17851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789121114.166690:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789121114.166704:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121114.166719:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121114.166731:0:17851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789121114.166735:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946784ac0800 from 19 10000000:01000000:2.0:1789121114.166738:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789121114.166798:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121114.166806:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121114.166839:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121114.166874:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970700288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789121114.166963:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121114.167023:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa4219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121114.167684:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970700288 00000100:00100000:3.0:1789121114.167693:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970700288 00000100:00100000:3.0:1789121114.167755:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789121114.167766:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+17:17851:x1876028970700288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121114.167796:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121114.167817:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a54800/0xb74d2367a8310707 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310700 expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121114.167865:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a54800/0xb74d2367a8310707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310700 expref: 18 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121114.167892:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a54800/0xb74d2367a8310707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310700 expref: 18 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121114.167904:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a54800, rc 0) 00000100:00100000:3.0:1789121114.167971:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:17851:x1876028970700288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121114.167979:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789121114.168693:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970700288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121114.168720:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121114.168731:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121114.168873:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970700416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121114.168933:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121114.168974:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa4219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121114.169671:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970700416 00000100:00100000:3.0:1789121114.169680:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970700416 00000100:00100000:3.0:1789121114.169738:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789121114.169747:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:17851:x1876028970700416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121114.169943:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:17851:x1876028970700416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 197us (1010us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121114.169952:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789121114.170679:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970700416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121114.170743:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970700544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789121114.170817:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121114.170886:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468aa4219c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121114.171023:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970700544 00000100:00100000:3.0:1789121114.171030:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970700544 00000100:00100000:3.0:1789121114.171218:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789121114.171229:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:17851:x1876028970700544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789121114.171362:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:17851:x1876028970700544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121114.171369:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789121114.171595:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970700544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789121114.175260:0:19068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789121114.180433:0:17851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789121114.180491:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789121114.180508:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121114.180548:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:1.0:1789121114.544001:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1789121114.584311:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121115.603653:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789121115.794544:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789121116.626129:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121117.651696:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121118.674968:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121119.124708:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970700672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789121119.124855:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121119.124945:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970700800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121119.124976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789121119.126118:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121119.126142:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121119.126145:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121119.126149:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121119.126171:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121119.126175:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789121119.126178:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789121119.126182:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789121119.126468:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970700928:0@lo:400:kworker.0 00000100:00100000:0.0:1789121119.126540:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121119.126647:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970700928 00000100:00100000:1.0:1789121119.126657:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970700928 00000100:00100000:1.0:1789121119.126726:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789121119.126998:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970700672 00000100:00100000:3.0:1789121119.127004:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970700672 00000100:00100000:1.0:1789121119.127392:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:3647:x1876028970700928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121119.127482:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:3647:x1876028970700928:12345-0@lo:400:kworker.0 Request processed in 96us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121119.127490:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789121119.127657:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970700928:0@lo:400:kworker.0 00000100:00100000:3.0:1789121119.128148:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970700800 00000100:00100000:3.0:1789121119.128154:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970700800 00000100:00100000:3.0:1789121119.128176:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789121119.128184:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970700672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789121119.128225:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789121119.129464:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970700672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1273us (4637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121119.129477:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789121119.129510:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789121119.129520:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970700800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789121119.129553:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789121119.129601:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970700800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (4623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121119.129607:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789121119.129669:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970700800:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121119.129705:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970701056:0@lo:400:kworker.0 00000100:00100000:3.0:1789121119.130234:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121119.132697:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789121119.132724:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970701184:0@lo:400:kworker.0 00000100:00100000:3.0:1789121119.132803:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121119.132905:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970700672:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789121119.132940:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970701056 00000100:00100000:3.0:1789121119.132948:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970701056 00000100:00100000:3.0:1789121119.132999:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970701184 00000100:00100000:3.0:1789121119.133003:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970701184 00000100:00100000:3.0:1789121119.133022:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789121119.133031:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970701056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121119.133094:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970701056:12345-0@lo:400:kworker.0 Request processed in 63us (2863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121119.133102:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789121119.133122:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789121119.133129:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970701184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121119.133154:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970701184:12345-0@lo:400:kworker.0 Request processed in 25us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121119.133161:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789121119.133191:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946784b2cf00 x1876028970701184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121119.133204:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970701184:0@lo:400:kworker.0 00010000:00080000:3.0:1789121119.133215:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946784b2c3c0 x1876028970701056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121135 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121119.133225:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970701056:0@lo:400:kworker.0 00010000:00010000:3.0:1789121119.698262:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789121120.213615:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789121120.732048:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789121121.389692:0:19361:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789121121.389697:0:19361:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1789121121.389699:0:19361:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1789121121.389941:0:19361:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9468c081e000 00000020:01000004:3.0:1789121121.389963:0:19361:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1789121121.389981:0:19361:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789121121.390001:0:19361:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9468ab904ed8) 00000020:00000080:3.0:1789121121.390024:0:19361:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1789121121.501257:0:19361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1789121121.504653:0:19361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1789121121.510045:0:19361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1789121121.511158:0:19361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:1.0:1789121121.514216:0:19361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1789121121.515017:0:19361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1789121121.517048:0:19361:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:1.0:1789121121.521003:0:19361:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789121121.521475:0:19361:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1789121121.521493:0:19361:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789121121.521518:0:19361:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb74d2367a8310715 00000020:01000004:1.0:1789121121.521528:0:19361:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789121121.521568:0:19361:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1789121121.521574:0:19361:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1789121121.521583:0:19361:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1789121121.521589:0:19361:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1789121121.521606:0:19361:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff946882bf4ed8) 00000020:00000080:1.0:1789121121.521619:0:19361:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:1.0:1789121121.526940:0:19361:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789121121.527535:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:1.0:1789121121.527542:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789121121.528770:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789121121.528780:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789121121.532552:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789121121.532588:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789121121.539720:0:19361:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789121121.540249:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789121121.540256:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789121121.547876:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789121121.547901:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789121121.596399:0:19361:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789121121.596673:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789121121.596680:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789121121.599191:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789121121.599207:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789121121.601454:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789121121.601468:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789121121.612542:0:19361:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789121121.615711:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789121121.615726:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789121121.620390:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789121121.620405:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:3.0:1789121121.746046:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121121.801655:0:19361:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789121121.802631:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789121121.802641:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789121121.808707:0:19361:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789121121.808723:0:19361:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789121121.809465:0:19361:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789121121.809496:0:19361:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1789121121.809503:0:19361:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789121121.835355:0:19361:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789121121.835409:0:19361:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.132@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1789121121.835414:0:19361:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789121121.835416:0:19361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789121121.835417:0:19361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121121.835419:0:19361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121121.835420:0:19361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121121.835421:0:19361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121121.835423:0:19361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789121121.835425:0:19361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121121.835431:0:19361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789121121.835434:0:19361:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1789121121.835436:0:19361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789121121.835438:0:19361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789121121.835439:0:19361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121121.835439:0:19361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121121.835440:0:19361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121121.835441:0:19361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121121.835442:0:19361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789121121.835443:0:19361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121121.835444:0:19361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789121121.835481:0:19361:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789121121.835502:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701312:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789121121.835589:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121121.835647:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783030b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789121121.835741:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970701312 00000100:00100000:3.0:1789121121.835748:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970701312 00000100:00100000:3.0:1789121121.835814:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789121121.835856:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:19361:x1876028970701312:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789121121.835899:0:17847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789121121.835902:0:17847:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789121121.835907:0:17847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789121121.837020:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:19361:x1876028970701312:12345-0@lo:253:mount.lustre.0 Request processed in 1162us (1426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121121.837044:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789121121.837346:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701312:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789121121.837360:0:19361:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789121121.837364:0:19361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789121121.837366:0:19361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789121121.837367:0:19361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121121.837368:0:19361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121121.837370:0:19361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121121.837371:0:19361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121121.837372:0:19361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789121121.837373:0:19361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121121.837375:0:19361:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789121121.837394:0:19361:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9468c081e000 from lustre-OST0000 10000000:01000000:2.0:1789121121.837438:0:19361:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789121121.837441:0:19361:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789121121.837450:0:19361:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff946783ca3490 local copy 00010000:00010000:2.0:1789121121.837460:0:19361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121121.837571:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701440:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121121.837616:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121121.837723:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2240 going to sleep for 11 seconds 00000100:00100000:0.0:1789121121.844273:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970701440 00000100:00100000:0.0:1789121121.844294:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970701440 00000100:00100000:0.0:1789121121.844378:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789121121.844390:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:19361:x1876028970701440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121121.844583:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:19361:x1876028970701440:12345-0@lo:501:mount.lustre.0 Request processed in 195us (6966us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789121121.844590:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789121121.845548:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75d2c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701440:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789121121.845584:0:19361:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789121121.845628:0:19361:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789121121.845638:0:19361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121121.845649:0:19361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121121.845691:0:19361:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9468c081e000 10000000:01000000:3.0:1789121121.845697:0:19361:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789121121.845702:0:19361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789121121.845705:0:19361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789121121.845718:0:19361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789121121.845722:0:19361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789121121.845759:0:19361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121121.845766:0:19361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121121.845777:0:19361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121121.845806:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701568:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789121121.845894:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121121.845935:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121121.846129:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970701568 00000100:00100000:2.0:1789121121.846135:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970701568 00000100:00100000:2.0:1789121121.846182:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789121121.846191:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+18:19361:x1876028970701568:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121121.846213:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121121.846227:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783c3bc00/0xb74d2367a831072a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310723 expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121121.846252:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783c3bc00/0xb74d2367a831072a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310723 expref: 19 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121121.846265:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783c3bc00/0xb74d2367a831072a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310723 expref: 19 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121121.846274:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783c3bc00, rc 0) 00000100:00100000:2.0:1789121121.846319:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:19361:x1876028970701568:12345-0@lo:101:mount.lustre.0 Request processed in 129us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121121.846326:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789121121.848177:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121121.848217:0:19361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121121.848231:0:19361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789121121.860148:0:19361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789121121.862255:0:19361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121121.869612:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789121121.871154:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789121121.871195:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789121121.871305:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789121121.871321:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789121121.871337:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789121121.871371:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789121121.871378:0:19361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789121121.871497:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121121.871584:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121121.871671:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff946881377480 going to sleep for 11 seconds 00000100:00100000:2.0:1789121121.884768:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970701696 00000100:00100000:2.0:1789121121.884885:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970701696 00000100:00100000:2.0:1789121121.885059:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789121121.885072:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:19361:x1876028970701696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121121.885649:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:19361:x1876028970701696:12345-0@lo:501:mount.lustre.0 Request processed in 578us (14063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121121.885659:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789121121.885757:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701696:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121121.886496:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701824:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121121.886579:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121121.890807:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff946881377480 going to sleep for 11 seconds 00000100:00100000:2.0:1789121121.891531:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970701824 00000100:00100000:2.0:1789121121.891572:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970701824 00000100:00100000:2.0:1789121121.891699:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789121121.891709:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:19361:x1876028970701824:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121121.893238:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:19361:x1876028970701824:12345-0@lo:503:mount.lustre.0 Request processed in 1518us (6647us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121121.893255:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789121121.896622:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701824:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789121121.897179:0:19361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789121121.897289:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121121.897372:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121121.897428:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970701952 00000100:00100000:3.0:1789121121.897431:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789121121.897436:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970701952 00000100:00100000:0.0:1789121121.897494:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789121121.897505:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:19361:x1876028970701952:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121121.898126:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:19361:x1876028970701952:12345-0@lo:502:mount.lustre.0 Request processed in 621us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121121.898135:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789121121.899893:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970701952:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121121.900185:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789121121.900237:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789121121.900255:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789121121.900269:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789121121.900282:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789121121.900318:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789121121.900336:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789121121.900352:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789121121.900367:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789121121.900382:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789121121.900395:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789121121.900426:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789121121.900466:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121121.900546:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121121.900596:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789121121.903141:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970702080 00000100:00100000:1.0:1789121121.903156:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970702080 00000100:00100000:1.0:1789121121.903229:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789121121.903241:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:19361:x1876028970702080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121121.903445:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:19361:x1876028970702080:12345-0@lo:502:mount.lustre.0 Request processed in 205us (2897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121121.903454:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789121121.903809:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121121.903944:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789121121.903958:0:19361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1789121121.905079:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789121121.905089:0:19378:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1789121121.905095:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121121.905098:0:19378:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789121121.905104:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789121121.905128:0:19378:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff94688415ced8) 00000020:00000080:0.0:1789121121.905164:0:19378:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789121121.905171:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789121121.905252:0:19378:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468c081e000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789121121.905261:0:19378:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789121121.905268:0:19378:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xb74d2367a8310738 00010000:00010000:0.0:1789121121.914215:0:19378:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1789121121.915115:0:19378:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789121121.918014:0:19378:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1789121121.924340:0:19378:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789121121.924359:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121121.924367:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121121.924369:0:19378:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789121121.924373:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789121121.924376:0:19378:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:0.0:1789121121.924378:0:19378:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789121121.924379:0:19378:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789121121.924381:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789121121.924384:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121121.924385:0:19378:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789121121.924387:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121121.924390:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121121.924391:0:19378:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789121121.924395:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789121121.924397:0:19378:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789121121.924399:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121121.924401:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121121.924402:0:19378:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789121121.924404:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789121121.924405:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121121.924407:0:19378:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789121121.924409:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789121121.924435:0:19378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789121121.924437:0:19378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789121121.924444:0:19378:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789121121.924448:0:19378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789121121.925154:0:19361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789121121.925189:0:19361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789121121.925211:0:19361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121121.925224:0:19361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a55800/0xb74d2367a8310723 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a831072a expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121121.925233:0:19361:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468c081e000 from 1 10000000:01000000:2.0:1789121121.925236:0:19361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789121121.925709:0:19361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121121.925719:0:19361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121121.925731:0:19361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121121.925759:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702208:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789121121.925857:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121121.925904:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789121121.926723:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970702208 00000100:00100000:1.0:1789121121.926733:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970702208 00000100:00100000:1.0:1789121121.926789:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789121121.926801:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:19361:x1876028970702208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121121.926815:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121121.926859:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310746 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831073f expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121121.926886:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310746 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831073f expref: 20 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121121.926897:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310746 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831073f expref: 20 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121121.926913:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3200, rc 0) 00000100:00100000:1.0:1789121121.926968:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:19361:x1876028970702208:12345-0@lo:101:mount.lustre.0 Request processed in 169us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121121.926976:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789121121.927110:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702208:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121121.927133:0:19361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121121.927143:0:19361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789121121.934399:0:19361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789121121.934871:0:19361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789121121.935138:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789121121.935168:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789121121.935189:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789121121.935195:0:19361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789121121.935274:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121121.935351:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121121.935394:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789121121.936195:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970702336 00000100:00100000:1.0:1789121121.936204:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970702336 00000100:00100000:1.0:1789121121.936260:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789121121.936279:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:19361:x1876028970702336:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789121121.936419:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:19361:x1876028970702336:12345-0@lo:501:mount.lustre.0 Request processed in 150us (1067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121121.936427:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789121121.936883:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702336:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121121.936927:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702464:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121121.936977:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121121.937058:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789121121.941876:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970702464 00000100:00100000:1.0:1789121121.941888:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970702464 00000100:00100000:1.0:1789121121.941939:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789121121.941948:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:19361:x1876028970702464:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789121121.942112:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:19361:x1876028970702464:12345-0@lo:503:mount.lustre.0 Request processed in 165us (5134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121121.942119:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789121121.942288:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702464:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789121121.942686:0:19361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789121121.943050:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702592:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121121.943106:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121121.943133:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789121121.943375:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970702592 00000100:00100000:1.0:1789121121.943380:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970702592 00000100:00100000:1.0:1789121121.943440:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789121121.943449:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:19361:x1876028970702592:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121121.943539:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:19361:x1876028970702592:12345-0@lo:502:mount.lustre.0 Request processed in 91us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121121.943546:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789121121.945112:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702592:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789121121.945403:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789121121.945444:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789121121.945463:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789121121.945479:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789121121.945496:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789121121.945529:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789121121.945546:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789121121.945579:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:2.0:1789121121.945595:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:2.0:1789121121.946497:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:2.0:1789121121.946537:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:2.0:1789121121.946570:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:2.0:1789121121.946588:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:2.0:1789121121.946603:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:2.0:1789121121.946630:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:2.0:1789121121.946647:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:2.0:1789121121.946659:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:2.0:1789121121.947864:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121121.947971:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121121.948012:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1789121121.949419:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970702720 00000100:00100000:1.0:1789121121.949430:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970702720 00000100:00100000:1.0:1789121121.949500:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789121121.949511:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:19361:x1876028970702720:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121121.949695:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:19361:x1876028970702720:12345-0@lo:502:mount.lustre.0 Request processed in 185us (1724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121121.949713:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789121121.950963:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789121121.951064:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:2.0:1789121121.951080:0:19361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:1.0:1789121121.952131:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121121.952142:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952145:0:19382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789121121.952152:0:19382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9468c081e000 00000020:00000080:1.0:1789121121.952155:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789121121.952162:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121121.952164:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952166:0:19382:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789121121.952168:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121121.952170:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952171:0:19382:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789121121.952174:0:19382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9468c081e000 00000020:00000080:1.0:1789121121.952176:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789121121.952231:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121121.952235:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952237:0:19382:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789121121.952239:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121121.952241:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952243:0:19382:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789121121.952246:0:19382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468c081e000 00000020:00000080:1.0:1789121121.952248:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789121121.952287:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121121.952290:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952291:0:19382:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789121121.952294:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121121.952302:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952303:0:19382:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789121121.952308:0:19382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468c081e000 00000020:00000080:1.0:1789121121.952310:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789121121.952329:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121121.952332:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952333:0:19382:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:1.0:1789121121.952336:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121121.952338:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952339:0:19382:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789121121.952342:0:19382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468c081e000 00000020:00000080:1.0:1789121121.952343:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789121121.952357:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121121.952359:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952360:0:19382:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789121121.952362:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789121121.952364:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952366:0:19382:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789121121.952369:0:19382:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468c081e000 00000020:00000080:1.0:1789121121.952370:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789121121.952389:0:19382:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789121121.952391:0:19382:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789121121.952393:0:19382:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789121121.952395:0:19382:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:3.0:1789121121.952862:0:19361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:3.0:1789121121.952893:0:19361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789121121.952915:0:19361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121121.952929:0:19361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121121.952989:0:19361:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789121121.952992:0:19361:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9468c081e000 10000000:01000000:3.0:1789121121.952996:0:19361:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9468c081e000 10000000:01000000:3.0:1789121121.953000:0:19361:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789121121.953006:0:19361:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9468c081e000 from 1 10000000:01000000:3.0:1789121121.953009:0:19361:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789121121.953050:0:19361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121121.953060:0:19361:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121121.953072:0:19361:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121121.953100:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702848:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789121121.953181:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121121.953216:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aae480 going to sleep for 11 seconds 00000100:00100000:1.0:1789121121.953323:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970702848 00000100:00100000:1.0:1789121121.953330:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970702848 00000100:00100000:1.0:1789121121.953369:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789121121.953379:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:19361:x1876028970702848:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121121.953392:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121121.953405:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a3a00/0xb74d2367a8310754 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831074d expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121121.953442:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3a00/0xb74d2367a8310754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831074d expref: 21 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121121.953452:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a3a00/0xb74d2367a8310754 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831074d expref: 21 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121121.953461:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3a00, rc 0) 00000100:00100000:1.0:1789121121.953499:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970702848:12345-0@lo:101:mount.lustre.0 Request processed in 121us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121121.953506:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789121121.953602:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702848:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789121121.953639:0:19361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121121.953648:0:19361:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789121121.955391:0:19361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1789121121.956257:0:19361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789121121.957950:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789121121.957984:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789121121.957998:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789121121.958010:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789121121.958041:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789121121.958055:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789121121.958067:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789121121.958079:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789121121.958091:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789121121.958103:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789121121.958117:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789121121.958129:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789121121.958141:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789121121.958151:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789121121.958167:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789121121.958179:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789121121.958192:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789121121.958203:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789121121.958216:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789121121.958228:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789121121.958253:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789121121.958269:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789121121.958301:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789121121.958311:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789121121.958333:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:3.0:1789121121.958346:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:3.0:1789121121.958359:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:3.0:1789121121.958370:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:3.0:1789121121.958382:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1789121121.958394:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1789121121.958406:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1789121121.958419:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1789121121.958431:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1789121121.958443:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1789121121.958454:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1789121121.958466:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1789121121.958488:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1789121121.958508:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1789121121.958513:0:19361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789121121.960401:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121121.960488:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121121.965177:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121121.966847:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970702976 00000100:00100000:0.0:1789121121.966861:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970702976 00000100:00100000:0.0:1789121121.966916:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789121121.966926:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970702976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121121.967091:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970702976:12345-0@lo:501:mount.lustre.0 Request processed in 167us (6603us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121121.967099:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789121121.968005:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970702976:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121121.968064:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970703104:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789121121.968123:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121121.968893:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970703104 00000100:00100000:0.0:1789121121.968900:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970703104 00000100:00100000:0.0:1789121121.968944:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789121121.968953:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970703104:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789121121.969402:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aae6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121121.970812:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970703104:12345-0@lo:503:mount.lustre.0 Request processed in 1851us (2680us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121121.970845:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789121121.971047:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970703104:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789121121.972978:0:19361:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789121121.973072:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970703232:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121121.973151:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121121.973201:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970703232 00000100:00100000:3.0:1789121121.973206:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970703232 00000100:00100000:3.0:1789121121.973255:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789121121.973263:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970703232:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121121.976583:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970703232:12345-0@lo:502:mount.lustre.0 Request processed in 3311us (3422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121121.976597:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789121121.977901:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aae480 going to sleep for 11 seconds 00000100:00100000:3.0:1789121121.977933:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970703232:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789121121.978166:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1789121121.978198:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1789121121.978215:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1789121121.978230:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1789121121.978244:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1789121121.978258:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789121121.980446:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789121121.980506:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789121121.980524:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789121121.980538:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789121121.980551:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789121121.980579:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789121121.980593:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789121121.980607:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789121121.980620:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789121121.980645:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789121121.980673:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789121121.980687:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789121121.980699:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789121121.981398:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789121121.981418:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789121121.981431:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789121121.981444:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789121121.981459:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789121121.981472:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1789121121.981484:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1789121121.981497:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1789121121.981509:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1789121121.981522:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1789121121.981534:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1789121121.981547:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1789121121.981571:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1789121121.981607:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1789121121.981623:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1789121121.981635:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1789121121.981645:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1789121121.981658:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1789121121.981670:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1789121121.981682:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1789121121.981693:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1789121121.982625:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1789121121.982657:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1789121121.982670:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1789121121.982682:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1789121121.982695:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1789121121.982875:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1789121121.982891:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1789121121.982903:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1789121121.982979:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970703360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121121.983063:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121121.983107:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff946781089780 going to sleep for 11 seconds 00000100:00100000:0.0:1789121121.983183:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970703360 00000100:00100000:0.0:1789121121.983190:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970703360 00000100:00100000:0.0:1789121121.983393:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789121121.983403:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970703360:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121121.983604:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970703360:12345-0@lo:502:mount.lustre.0 Request processed in 202us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121121.983612:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789121121.995350:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970703360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789121121.995679:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1789121121.995720:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1789121121.995761:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970703488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121121.995860:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121121.995914:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468878c1300 going to sleep for 11 seconds 00000100:00100000:3.0:1789121121.996343:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970703488 00000100:00100000:3.0:1789121121.996350:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970703488 00000100:00100000:3.0:1789121121.996400:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789121121.996409:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970703488:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121121.996529:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970703488:12345-0@lo:502:mount.lustre.0 Request processed in 120us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121121.996537:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789121121.998164:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970703488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789121121.998596:0:19361:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1789121121.998611:0:19361:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789121122.001075:0:19387:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789121122.001094:0:19387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff946882bf3490) 00000020:00000080:1.0:1789121122.001120:0:19387:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789121122.001200:0:19387:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468c081e000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789121122.001302:0:19387:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468c081e000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789121122.001305:0:19387:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468c081e000 3 00010000:00080000:1.0:1789121122.001336:0:19387:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468afc68800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.132@tcp at head 00010000:00010000:1.0:1789121122.009772:0:19387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1789121122.011581:0:19387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789121122.011642:0:19387:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789121122.011657:0:19387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xb74d2367a8310762 00000100:00080000:2.0:1789121122.011671:0:19387:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789121122.011678:0:19387:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9468afc68800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121122.011715:0:19387:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf75cb40 x1876028970703616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121122.011761:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970703616:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789121122.011851:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789121122.011914:0:19387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789121122.012303:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970703616 00000100:00100000:3.0:1789121122.012315:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970703616 00000100:00100000:3.0:1789121122.012359:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789121122.012368:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3643:x1876028970703616:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789121122.012395:0:17854:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:3.0:1789121122.012450:0:17854:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xb74d2367a8310769 00000004:00100000:3.0:1789121122.012474:0:17854:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789121122.012513:0:17854:0:(import.c:65:import_set_state_nolock()) ffff9468afd51000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121122.012588:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3643:x1876028970703616:12345-0@lo:38:llog_process_th.0 Request processed in 219us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121122.012596:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789121122.012639:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468bf75cb40 x1876028970703616/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121122.012649:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789121122.012657:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1789121122.012664:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789121122.012667:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789121122.012669:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468afc68800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789121122.012675:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3643:1876028970703616:0@lo:38:llog_process_th.0 00000100:00080000:0.0:1789121122.015214:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121122.015222:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121122.015225:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121122.015234:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121122.015263:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121122.015267:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121122.015270:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121122.015273:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789121122.015318:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970703744:0@lo:400:kworker.0 00000100:00100000:0.0:1789121122.015389:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121122.015429:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789121122.015435:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970703872:0@lo:400:kworker.0 00000100:00100000:0.0:1789121122.015464:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121122.015501:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970704000:0@lo:400:kworker.0 00000100:00100000:0.0:1789121122.015525:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121122.015543:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121122.015548:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970704128:0@lo:400:kworker.0 00000100:00100000:0.0:1789121122.015584:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121122.015635:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970703744 00000100:00100000:0.0:1789121122.015643:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970703744 00000100:00100000:0.0:1789121122.015687:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970704000 00000100:00100000:0.0:1789121122.015690:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970704000 00000100:00100000:0.0:1789121122.015719:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789121122.015727:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970703744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121122.015779:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970703744:12345-0@lo:400:kworker.0 Request processed in 52us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121122.015786:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789121122.015803:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789121122.015818:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970704000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121122.015872:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970704000:12345-0@lo:400:kworker.0 Request processed in 56us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121122.015878:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789121122.015904:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970703872 00000100:00100000:0.0:1789121122.015908:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970703872 00000100:00100000:0.0:1789121122.015930:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970704128 00000100:00100000:0.0:1789121122.015933:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970704128 00000100:00100000:0.0:1789121122.015944:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789121122.015950:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970703872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121122.015978:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970703872:12345-0@lo:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121122.015983:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789121122.015994:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789121122.015999:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970704128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121122.016024:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970704128:12345-0@lo:400:kworker.0 Request processed in 25us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121122.016030:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1789121122.016073:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946783d1e1c0 x1876028970704128/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121122.016088:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970704128:0@lo:400:kworker.0 00000100:00100000:0.0:1789121122.016099:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970704000:0@lo:400:kworker.0 00010000:00080000:0.0:1789121122.016126:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff946783d1de00 x1876028970703872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121122.016134:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970703872:0@lo:400:kworker.0 00000100:00100000:0.0:1789121122.016163:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970703744:0@lo:400:kworker.0 00000020:01000004:2.0:1789121122.026027:0:19387:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789121122.026047:0:19387:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff946783c79a48) 00000020:00000080:2.0:1789121122.026073:0:19387:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789121122.026164:0:19387:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468c081e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789121122.026168:0:19387:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468c081e000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789121122.026171:0:19387:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468c081e000 3 00010000:00080000:2.0:1789121122.026506:0:19387:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9468aa981800@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789121122.034933:0:19387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1789121122.035163:0:19387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1789121122.036862:0:19387:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789121122.036885:0:19387:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xb74d2367a8310777 00000100:00080000:2.0:1789121122.036897:0:19387:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789121122.036905:0:19387:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9468aa981800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121122.036945:0:19387:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf75e580 x1876028970704256/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121122.036993:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876028970704256:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789121122.037075:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789121122.037141:0:19387:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789121122.037646:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970704256 00000100:00100000:0.0:1789121122.037654:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970704256 00000100:00100000:0.0:1789121122.037690:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789121122.037699:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3643:x1876028970704256:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789121122.037730:0:17856:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 572 last 0 00000020:00000080:0.0:1789121122.037765:0:17856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xb74d2367a831077e 00000004:00100000:0.0:1789121122.037781:0:17856:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789121122.037913:0:17856:0:(import.c:65:import_set_state_nolock()) ffff9467838ef000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789121122.037986:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3643:x1876028970704256:12345-0@lo:38:llog_process_th.0 Request processed in 287us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121122.037994:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789121122.038019:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121122.038023:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121122.038026:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121122.038029:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121122.038033:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121122.038036:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121122.038039:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121122.038533:0:8921:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:2.0:1789121122.041361:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9468bf75e580 x1876028970704256/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121122.041377:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789121122.041387:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1789121122.041396:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789121122.041402:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789121122.041405:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468aa981800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789121122.041412:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3643:1876028970704256:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1789121122.041551:0:19387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1789121122.041646:0:19361:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789121122.041683:0:19361:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789121122.041698:0:19361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121122.041716:0:19361:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a54e00/0xb74d2367a831074d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310754 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789121122.041767:0:19361:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789121122.041769:0:19361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789121122.041771:0:19361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789121122.041772:0:19361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789121122.041773:0:19361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789121122.041774:0:19361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789121122.041776:0:19361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789121122.041778:0:19361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789121122.041779:0:19361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789121122.041783:0:19361:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789121122.041785:0:19361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789121122.041786:0:19361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789121122.041787:0:19361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789121122.041788:0:19361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789121122.042227:0:19361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789121122.042231:0:19361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789121122.042233:0:19361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789121122.042234:0:19361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789121122.042235:0:19361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789121122.042260:0:19361:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789121122.042279:0:19361:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970704384:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789121122.042910:0:19361:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121122.042960:0:19361:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467831f7b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789121122.043342:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970704384 00000100:00100000:2.0:1789121122.043351:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970704384 00000100:00100000:2.0:1789121122.043400:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789121122.043409:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970704384:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789121122.043437:0:17847:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789121122.043457:0:17847:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789121122.053579:0:17847:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789121122.053604:0:17847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1789121122.053895:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:19361:x1876028970704384:12345-0@lo:253:mount.lustre.0 Request processed in 10482us (10981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121122.053908:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 20000000:01000000:2.0:1789121122.053986:0:17870:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789121122.053991:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789121122.054015:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.054034:0:17870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a55200/0xb74d2367a83106cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83106c8 expref: 20 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.054042:0:17870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946783e23200/0xb74d2367a83106dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83106d6 expref: 20 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.054051:0:17870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.054093:0:17870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946783e23200/0xb74d2367a83106dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a83106d6 expref: 20 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121122.054172:0:19361:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f0c0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:19361:1876028970704384:0@lo:253:mount.lustre.0 00010000:00010000:2.0:1789121122.054185:0:17870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946783e23200/0xb74d2367a83106dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a83106d6 expref: 20 pid: 17849 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121122.054187:0:19361:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789121122.054190:0:19361:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789121122.054192:0:19361:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789121122.054193:0:19361:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789121122.054194:0:19361:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789121122.054195:0:19361:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:2.0:1789121122.054199:0:17870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970704512:0@lo:104: 00000020:01000004:0.0:1789121122.054202:0:19361:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789121122.054204:0:19361:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789121122.054205:0:19361:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789121122.054207:0:19361:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789121122.054222:0:19361:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1789121122.054233:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789121122.054273:0:17870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a55200/0xb74d2367a83106cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a83106c8 expref: 20 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.054281:0:17870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946899a55200/0xb74d2367a83106cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a83106c8 expref: 20 pid: 17847 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121122.054290:0:17870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970704640:0@lo:104: 00000100:00100000:2.0:1789121122.054313:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121122.054337:0:17870:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783c0e600 going to sleep for 11 seconds 00000100:00100000:2.0:1789121122.054356:0:17838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789121122.054373:0:17838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970704512 00000100:00100000:2.0:1789121122.054378:0:17838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970704512 00000100:00100000:2.0:1789121122.054409:0:17838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970704640 00000100:00100000:2.0:1789121122.054412:0:17838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970704640 00000100:00100000:2.0:1789121122.054427:0:17838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789121122.054436:0:17838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+4:17870:x1876028970704512:12345-0@lo:104: 00010000:00010000:2.0:1789121122.054451:0:17838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.054495:0:17838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789121122.054501:0:17838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75d680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+4:17870:x1876028970704512:12345-0@lo:104: Request processed in 68us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121122.054508:0:17838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789121122.054520:0:17838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789121122.054526:0:17838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94689dfb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:17870:x1876028970704640:12345-0@lo:104: 00010000:00010000:2.0:1789121122.054534:0:17838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.054575:0:17838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789121122.054580:0:17838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94689dfb4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:17870:x1876028970704640:12345-0@lo:104: Request processed in 55us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121122.054586:0:17838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1789121122.054630:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121122.054637:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.054644:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121122.054655:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.054664:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121122.054672:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121122.054679:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789121122.055138:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055147:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121122.055172:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055179:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783e23c00/0xb74d2367a83106d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83106dd expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055190:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121122.055194:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055200:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:2.0:1789121122.055203:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055209:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789121122.055223:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121122.055229:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789121122.055243:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055248:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789121122.055254:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055261:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a2000/0xb74d2367a83106c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83106cf expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055272:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121122.055274:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121122.055275:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121122.055282:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121122.055293:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970704768:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121122.055331:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121122.055354:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789121122.055359:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970704896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121122.055378:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121122.055405:0:17841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970704768 00000100:00100000:2.0:1789121122.055409:0:17841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970704768 00010000:00010000:2.0:1789121122.055425:0:17841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946783e23200/0xb74d2367a83106dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a83106d6 expref: 21 pid: 17849 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121122.055444:0:17841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970704896 00000100:00100000:2.0:1789121122.055451:0:17841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970704896 00010000:00010000:2.0:1789121122.055461:0:17841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a55200/0xb74d2367a83106cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a83106c8 expref: 22 pid: 17847 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121122.055473:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789121122.055479:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:3646:x1876028970704768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121122.055489:0:17841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121122.055493:0:17841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946783e23200/0xb74d2367a83106dd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a83106d6 expref: 22 pid: 17849 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055503:0:17841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946783e23200/0xb74d2367a83106dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a83106d6 expref: 22 pid: 17849 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055519:0:17841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121122.055546:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:3646:x1876028970704768:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121122.055571:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789121122.055586:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789121122.055593:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:3646:x1876028970704896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121122.055600:0:17841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121122.055604:0:17841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a55200/0xb74d2367a83106cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a83106c8 expref: 21 pid: 17847 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055613:0:17841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a55200/0xb74d2367a83106cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a83106c8 expref: 21 pid: 17847 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055625:0:17841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055634:0:17841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789121122.055653:0:17841:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024700313s 00010000:00010000:2.0:1789121122.055658:0:17841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055665:0:17841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055672:0:17841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055679:0:17841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055685:0:17841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3b200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121122.055688:0:17841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055696:0:17841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055716:0:17841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055725:0:17841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121122.055747:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839f0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:3646:x1876028970704896:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121122.055754:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789121122.055835:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970704896:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789121122.055845:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970704768:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121122.055881:0:17870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783e23200/0xb74d2367a83106dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a83106d6 expref: 20 pid: 17849 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121122.055890:0:17870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970704512:0@lo:104: 00010000:00010000:2.0:1789121122.055901:0:17870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55200/0xb74d2367a83106cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a83106c8 expref: 19 pid: 17847 timeout: 672 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121122.055909:0:17870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cb40 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970704640:0@lo:104: 00010000:00010000:2.0:1789121122.055921:0:17870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055930:0:17870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055936:0:17870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121122.055942:0:17870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783c3b200/0xb74d2367a8310785 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:2.0:1789121122.063576:0:19361:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789121122.083969:0:19361:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789121122.083978:0:19361:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789121122.084016:0:19361:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789121122.084071:0:19361:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789121122.084094:0:19361:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789121122.084123:0:19361:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1789121122.084969:0:19361:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121122.085179:0:19361:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789121122.771451:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1789121123.142138:0:19443:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789121123.142432:0:19443:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789121123.601966:0:17851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789121123.601984:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9468b9c33800 from 9 10000000:01000000:2.0:1789121123.601992:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789121123.602052:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121123.602068:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121123.602083:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121123.602126:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970705024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789121123.602227:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121123.602283:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789121123.602392:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970705024 00000100:00100000:3.0:1789121123.602411:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970705024 00000100:00100000:3.0:1789121123.602529:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789121123.602552:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+19:17851:x1876028970705024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121123.602571:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121123.602589:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55e00/0xb74d2367a8310793 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831078c expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121123.602623:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55e00/0xb74d2367a8310793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831078c expref: 20 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121123.602643:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55e00/0xb74d2367a8310793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831078c expref: 20 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121123.602655:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55e00, rc 0) 00000100:00100000:3.0:1789121123.602718:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:17851:x1876028970705024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121123.602725:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789121123.602816:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970705024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121123.602862:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121123.602871:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121123.602933:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970705152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789121123.602966:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121123.603366:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121123.603503:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970705152 00000100:00100000:1.0:1789121123.603509:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970705152 00000100:00100000:1.0:1789121123.603555:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789121123.603563:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:17851:x1876028970705152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789121123.603583:0:17848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789121123.603607:0:17848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789121123.603610:0:17848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789121123.604085:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:17851:x1876028970705152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 522us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121123.604099:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789121123.604168:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970705152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789121123.604243:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789121123.604252:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121123.604272:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121123.604282:0:17851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789121123.604284:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946784ac0800 from 9 10000000:01000000:2.0:1789121123.604287:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789121123.604314:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121123.604321:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121123.604330:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121123.604349:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970705280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789121123.604378:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121123.604534:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970705280 00000100:00100000:3.0:1789121123.604548:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970705280 00000100:00100000:3.0:1789121123.604621:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789121123.604629:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:17851:x1876028970705280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121123.604640:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121123.604654:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55a00/0xb74d2367a83107a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831079a expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121123.604692:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55a00/0xb74d2367a83107a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831079a expref: 21 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121123.604703:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55a00/0xb74d2367a83107a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831079a expref: 21 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121123.604712:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55a00, rc 0) 00000100:00100000:3.0:1789121123.604741:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:17851:x1876028970705280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121123.604748:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789121123.604788:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789121123.604813:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970705280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121123.604853:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121123.604863:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121123.604904:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970705408:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789121123.604933:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121123.605218:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946891801d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121123.605260:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970705408 00000100:00100000:1.0:1789121123.605265:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970705408 00000100:00100000:1.0:1789121123.605293:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789121123.605301:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:17851:x1876028970705408:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789121123.605315:0:17847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789121123.605332:0:17847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789121123.605335:0:17847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:1.0:1789121123.605671:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:17851:x1876028970705408:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 369us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121123.605735:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789121123.606559:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75e580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970705408:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789121123.606652:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789121123.606662:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121123.606674:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121123.794201:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121124.245317:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970705536:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789121124.245427:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121124.246905:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789121124.246927:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970705664:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121124.247009:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121124.248383:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970705536 00000100:00100000:0.0:1789121124.248396:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970705536 00000100:00100000:0.0:1789121124.248463:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970705664 00000100:00100000:0.0:1789121124.248467:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970705664 00000100:00100000:0.0:1789121124.248490:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789121124.248501:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970705536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789121124.248566:0:17860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789121124.248664:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970705536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 164us (3237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121124.248685:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789121124.248709:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789121124.248716:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970705664:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789121124.248737:0:17860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789121124.248773:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970705664:12345-0@lo:41:osp-pre-1-0.0 Request processed in 58us (1764us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121124.248779:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789121124.248891:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf70ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970705664:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121124.248910:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970705536:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789121124.821254:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121125.010575:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789121125.842493:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121126.871888:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789121127.313948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121127.313955:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121127.313958:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121127.313961:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121127.313997:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121127.314001:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121127.314004:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121127.314007:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789121127.314049:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970706048:0@lo:400:kworker.0 00000100:00100000:0.0:1789121127.314126:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121127.314161:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970706560:0@lo:400:kworker.0 00000100:00100000:0.0:1789121127.314190:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121127.314215:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121127.314222:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970706176:0@lo:400:kworker.0 00000100:00100000:0.0:1789121127.314250:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121127.314289:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970706048 00000100:00100000:0.0:1789121127.314296:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970706048 00000100:00100000:0.0:1789121127.314335:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970706560 00000100:00100000:0.0:1789121127.314338:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970706560 00000100:00100000:0.0:1789121127.314363:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789121127.314372:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970706048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121127.314422:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970706048:12345-0@lo:400:kworker.0 Request processed in 51us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121127.314429:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789121127.314446:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789121127.314452:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970706560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121127.314477:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970706560:12345-0@lo:400:kworker.0 Request processed in 25us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121127.314482:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789121127.314526:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970706176 00000100:00100000:0.0:1789121127.314530:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970706176 00000100:00100000:0.0:1789121127.314554:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789121127.314561:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970706176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121127.314595:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970706176:12345-0@lo:400:kworker.0 Request processed in 35us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121127.314601:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789121127.314641:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970706176:0@lo:400:kworker.0 00010000:00080000:0.0:1789121127.314653:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783d1cf00 x1876028970706048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121127.314663:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970706048:0@lo:400:kworker.0 00010000:00080000:0.0:1789121127.314673:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783d1f480 x1876028970706560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121127.314681:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970706560:0@lo:400:kworker.0 00000100:00100000:3.0:1789121127.314774:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970705792:0@lo:400:kworker.0 00000100:00100000:3.0:1789121127.314810:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121127.314869:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970706304:0@lo:400:kworker.0 00000100:00100000:3.0:1789121127.314893:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121127.314911:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789121127.314917:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970705920:0@lo:400:kworker.0 00000100:00100000:3.0:1789121127.314938:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121127.314955:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970706432:0@lo:400:kworker.0 00000100:00100000:3.0:1789121127.314976:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789121127.315008:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121127.315018:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970705920 00000100:00100000:3.0:1789121127.315022:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970705920 00000100:00100000:3.0:1789121127.315047:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789121127.315054:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970705920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121127.315090:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970705920:12345-0@lo:400:kworker.0 Request processed in 36us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121127.315096:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789121127.315124:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970705920:0@lo:400:kworker.0 00000100:00100000:3.0:1789121127.315141:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970706304 00000100:00100000:3.0:1789121127.315144:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970706304 00000100:00100000:3.0:1789121127.315166:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970706432 00000100:00100000:3.0:1789121127.315169:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970706432 00000100:00100000:3.0:1789121127.315185:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789121127.315190:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf70e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970706304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121127.315233:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf70e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1876028970706304:12345-0@lo:400:kworker.0 Request processed in 42us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121127.315239:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789121127.315250:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789121127.315256:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970706432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121127.315280:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c43c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970706432:12345-0@lo:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121127.315286:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789121127.315298:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789121127.315315:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783d1c3c0 x1876028970706432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121127.315325:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970706432:0@lo:400:kworker.0 00010000:00080000:3.0:1789121127.315334:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783d1cb40 x1876028970706304/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121127.315343:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3646:1876028970706304:0@lo:400:kworker.0 00000100:00100000:0.0:1789121127.315420:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970705792 00000100:00100000:0.0:1789121127.315424:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970705792 00000100:00100000:0.0:1789121127.315459:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789121127.315465:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:3646:x1876028970705792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121127.315499:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:3646:x1876028970705792:12345-0@lo:400:kworker.0 Request processed in 34us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121127.315517:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789121127.315930:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970705792:0@lo:400:kworker.0 00010000:00010000:3.0:1789121127.890191:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789121128.739240:0:19733:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789121128.920114:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121129.236481:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121114/real 1789121114] req@ffff9468bf75da40 x1876028970699648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121129 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121129.236533:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468bf75da40 x1876028970699648/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121129 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121129.236545:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121114/real 1789121114] req@ffff9468bf75e1c0 x1876028970699776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121129 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121129.236574:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468bf75e1c0 x1876028970699776/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121129 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789121129.236600:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468bf672000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121129.237504:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789121129.237513:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970699648:0@lo:8:kworker.0 00000100:00080000:3.0:1789121129.237523:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789121129.245718:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121129.245727:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121129.245738:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121129.245741:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121129.245760:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121129.245763:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1789121129.245768:0:37:0:(import.c:65:import_set_state_nolock()) ffff9468bf672000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121129.245779:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 564 00000100:00080000:0.0:1789121129.245789:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789121129.245797:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9468bf672000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121129.245841:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783d1d680 x1876028970707200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789121129.245855:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121129.245858:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789121129.245860:0:37:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789121129.245864:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 564 00000100:00080000:0.0:1789121129.245866:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1789121129.245871:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff946890f63000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:0.0:1789121129.245884:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946783d1de00 x1876028970707328/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789121129.245940:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970707072:0@lo:400:kworker.0 00000100:00100000:0.0:1789121129.246035:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.246087:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789121129.246094:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970706688:0@lo:400:kworker.0 00000100:00100000:0.0:1789121129.246126:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.246160:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970707456:0@lo:400:kworker.0 00000100:00100000:0.0:1789121129.246196:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.246434:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970706816:0@lo:400:kworker.0 00000100:00100000:0.0:1789121129.246467:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.246500:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970707584:0@lo:400:kworker.0 00000100:00100000:0.0:1789121129.246530:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.246553:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789121129.246558:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970706944:0@lo:400:kworker.0 00000100:00100000:0.0:1789121129.246581:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.246598:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970707712:0@lo:400:kworker.0 00000100:00100000:0.0:1789121129.246620:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.246705:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970707072 00000100:00100000:0.0:1789121129.246715:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970707072 00000100:00100000:0.0:1789121129.246768:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970706816 00000100:00100000:0.0:1789121129.246772:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970706816 00000100:00100000:0.0:1789121129.246794:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789121129.246804:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970707072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121129.246901:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970707072:12345-0@lo:400:kworker.0 Request processed in 98us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121129.246910:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789121129.246930:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789121129.246936:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970706816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121129.246969:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ea1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970706816:12345-0@lo:400:kworker.0 Request processed in 33us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121129.246975:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789121129.246996:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970706688 00000100:00100000:0.0:1789121129.246999:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970706688 00000100:00100000:0.0:1789121129.247047:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789121129.247053:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:3644:x1876028970706688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121129.247083:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:3644:x1876028970706688:12345-0@lo:400:kworker.0 Request processed in 31us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121129.247089:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789121129.247120:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970707456 00000100:00100000:0.0:1789121129.247124:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970707456 00000100:00100000:0.0:1789121129.247143:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970707584 00000100:00100000:0.0:1789121129.247145:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970707584 00000100:00100000:0.0:1789121129.247173:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970706944 00000100:00100000:0.0:1789121129.247175:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970706944 00000100:00100000:0.0:1789121129.247185:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970707712 00000100:00100000:0.0:1789121129.247187:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970707712 00000100:00100000:0.0:1789121129.247202:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789121129.247209:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970707456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121129.247295:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970706688:0@lo:400:kworker.0 00000100:00100000:1.0:1789121129.247313:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970707072:0@lo:400:kworker.0 00000100:00100000:1.0:1789121129.247357:0:17855:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789121129.247361:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ea580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970707456:12345-0@lo:400:kworker.0 Request processed in 152us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121129.247367:0:17855:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789121129.247368:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789121129.247379:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789121129.247383:0:17854:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789121129.247385:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970707584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121129.247414:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e8f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970707584:12345-0@lo:400:kworker.0 Request processed in 29us (882us total) trans 0 rc 0/0 00000100:00080000:2.0:1789121129.247627:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789121129.247644:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789121129.247966:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789121129.247981:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970706944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121129.248039:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970706944:12345-0@lo:400:kworker.0 Request processed in 63us (1457us total) trans 0 rc 0/0 00010000:00080000:2.0:1789121129.248936:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783d1da40 x1876028970706944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121129.248956:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970706944:0@lo:400:kworker.0 00000100:00100000:2.0:1789121129.248974:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970706816:0@lo:400:kworker.0 00010000:00080000:2.0:1789121129.248987:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783d1cb40 x1876028970707584/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121129.248996:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1cb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970707584:0@lo:400:kworker.0 00000100:00100000:2.0:1789121129.249260:0:19755:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1789121129.249268:0:19755:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:3.0:1789121129.250194:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789121129.250202:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970699776:0@lo:8:kworker.0 00000100:00100000:3.0:1789121129.250255:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970707200:0@lo:8:kworker.0 00000100:00100000:3.0:1789121129.250341:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121129.250387:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970707328:0@lo:8:kworker.0 00000100:00100000:3.0:1789121129.250429:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.254341:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789121129.254373:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789121129.254410:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789121129.254435:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970707712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121129.254515:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970707200 00000100:00100000:1.0:1789121129.254528:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970707200 00000100:00100000:1.0:1789121129.254569:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970707328 00000100:00100000:1.0:1789121129.254590:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970707328 00000100:00100000:0.0:1789121129.254593:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970707712:12345-0@lo:400:kworker.0 Request processed in 174us (7972us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121129.254605:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121129.254610:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970707200:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789121129.254610:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1789121129.254673:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783d1c3c0 x1876028970707712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121129.254692:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970707712:0@lo:400:kworker.0 00010000:00080000:0.0:1789121129.254742:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783d1f840 x1876028970707456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121129.254752:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970707456:0@lo:400:kworker.0 00010000:00080000:1.0:1789121129.254765:0:19366:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 579 last 0 00000100:00080000:0.0:1789121129.254779:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121129.254785:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789121129.254788:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789121129.254790:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000020:00000080:1.0:1789121129.254802:0:19366:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a83107a8 00002000:00100000:1.0:1789121129.254843:0:19366:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9468afc6c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1789121129.254848:0:19366:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1789121129.254851:0:19366:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789121129.255261:0:19366:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1789121129.255296:0:19366:0:(import.c:65:import_set_state_nolock()) ffff9468afc6f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789121129.255359:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876028970707200:12345-0@lo:8:kworker.0 Request processed in 748us (5018us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121129.255366:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121129.255385:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789121129.255389:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970707328:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1789121129.255475:0:19366:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789121129.273620:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946783d1d680 x1876028970707200/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789121149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121129.273640:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789121129.273654:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1789121129.273666:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789121129.273673:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789121129.273677:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468bf672000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789121129.273697:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789121129.273704:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970707200:0@lo:8:kworker.0 00000004:00080000:0.0:1789121129.273751:0:18599:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1789121129.273769:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970707328:12345-0@lo:8:kworker.0 Request processed in 18376us (23337us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789121129.273782:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:00080000:0.0:1789121129.273887:0:18599:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 579463065394ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789121129.273894:0:18599:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00080000:1.0:1789121129.274099:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121129.274105:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1789121129.274108:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970707328:0@lo:8:kworker.0 00000004:00080000:0.0:1789121129.274155:0:18600:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1789121129.274181:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18600:1876028970707968:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1789121129.274226:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.274254:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789121129.274270:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970707840:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121129.274289:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970707968 00000100:00100000:0.0:1789121129.274294:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970707968 00000100:00100000:1.0:1789121129.274306:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.274348:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789121129.274349:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970707840 00000100:00100000:0.0:1789121129.274357:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18600:x1876028970707968:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789121129.274358:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970707840 00000100:00100000:1.0:1789121129.274381:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789121129.274386:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876028970707840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789121129.274533:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789121129.274593:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2ed00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3644:x1876028970707840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 205us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121129.274600:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789121129.274628:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468938e8b40 x1876028970707840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789121145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121129.274643:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970707840:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789121129.275048:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789121129.276240:0:18590:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1789121129.277589:0:19367:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789121129.277600:0:19367:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789121129.277733:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ead00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18600:x1876028970707968:12345-0@lo:7:osp-pre-0-1.0 Request processed in 3369us (3498us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121129.277746:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789121129.278010:0:18600:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468938e83c0 x1876028970707968/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789121145 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121129.278031:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18600:1876028970707968:0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789121129.278049:0:18600:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:0.0:1789121129.278100:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18600:1876028970708096:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789121129.278143:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.278166:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789121129.278217:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970708096 00000100:00100000:1.0:1789121129.278225:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970708096 00000100:00100000:1.0:1789121129.278290:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789121129.278302:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18600:x1876028970708096:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789121129.278341:0:19366:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1789121129.278387:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938ebc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:18600:x1876028970708096:12345-0@lo:5:osp-pre-0-1.0 Request processed in 88us (244us total) trans 0 rc 0/0 00010000:00080000:0.0:1789121129.278419:0:18600:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468938e83c0 x1876028970708096/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789121145 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121129.278429:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18600:1876028970708096:0@lo:5:osp-pre-0-1.0 00000004:00080000:0.0:1789121129.278440:0:18600:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:1.0:1789121129.278459:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789121129.278468:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18600:1876028970708224:0@lo:5:osp-pre-0-1.0 00000100:00100000:0.0:1789121129.278501:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.278523:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b336c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789121129.278609:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970708224 00000100:00100000:1.0:1789121129.278613:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970708224 00000100:00100000:1.0:1789121129.278659:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789121129.278667:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18600:x1876028970708224:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1789121129.278709:0:19367:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:0.0:1789121129.296340:0:19362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789121129.296364:0:19362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:2.0:1789121129.297434:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e8b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:18600:x1876028970708224:12345-0@lo:5:osp-pre-0-1.0 Request processed in 18756us (18920us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789121129.297469:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789121129.297734:0:18600:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468938e83c0 x1876028970708224/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789121145 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121129.297750:0:18600:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1789121129.297760:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:18600:1876028970708224:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1789121129.297781:0:18600:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1789121129.297888:0:18600:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18600:1876028970708352:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1789121129.297943:0:18600:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121129.297976:0:18600:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aaea80 going to sleep for 11 seconds 00000100:00100000:1.0:1789121129.298079:0:17866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970708352 00000100:00100000:1.0:1789121129.298088:0:17866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970708352 00000100:00100000:1.0:1789121129.298553:0:17866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789121129.298567:0:17866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18600:x1876028970708352:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789121129.298642:0:17866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18600:x1876028970708352:12345-0@lo:900:osp-pre-0-1.0 Request processed in 79us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121129.298650:0:17866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789121129.298714:0:18600:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c5a40 x1876028970708352/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789121145 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121129.298743:0:18600:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c5a40 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:18600:1876028970708352:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789121129.363001:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121129.363046:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970708480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121129.363151:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.363210:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970708608:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121129.363240:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121129.363284:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970708480 00000100:00100000:0.0:1789121129.363293:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970708480 00000100:00100000:0.0:1789121129.363346:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970708608 00000100:00100000:0.0:1789121129.363349:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970708608 00000100:00100000:0.0:1789121129.363368:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789121129.363379:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970708480:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789121129.363441:0:17859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789121129.363509:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d2940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970708480:12345-0@lo:41:osp-pre-0-1.0 Request processed in 131us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121129.363519:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789121129.363540:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789121129.363547:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970708608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789121129.363590:0:17859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789121129.363625:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970708608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121129.364085:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789121129.364222:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468938e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970708480:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121129.364275:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970708608:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1789121129.827903:0:19787:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789121129.828239:0:19787:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789121129.938094:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789121130.452180:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:2.0:1789121130.763096:0:19838:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121130.763665:0:19838:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789121130.971593:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121131.985978:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121133.011077:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.034099:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121134.354927:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121114/real 1789121114] req@ffff9468bf75c780 x1876028970699392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121134 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121134.354967:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468bf75c780 x1876028970699392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121134 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121134.354977:0:3643:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789121114/real 1789121114] req@ffff9468bf75ed00 x1876028970699520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121134 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121134.354989:0:3643:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9468bf75ed00 x1876028970699520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789121134 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789121134.355013:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a2000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121134.355042:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789121134.355046:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970699392:0@lo:8:kworker.0 00000100:00080000:1.0:1789121134.355053:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789121134.355057:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789121134.355060:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970699520:0@lo:8:kworker.0 00000100:00080000:3.0:1789121134.359764:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121134.359776:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789121134.359781:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a08a2000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121134.359792:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 564 00000100:00080000:3.0:1789121134.359800:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789121134.359808:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9468a08a2000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121134.359878:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99c7480 x1876028970708992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789121134.359898:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121134.359902:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789121134.359903:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121134.359907:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 564 00000100:00080000:3.0:1789121134.359910:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789121134.359914:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9468a08a9800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121134.359926:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99c61c0 x1876028970709120/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789121134.359953:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121134.359956:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789121134.359958:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121134.359961:0:8921:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 579 00000100:00080000:3.0:1789121134.359971:0:8921:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789121134.359975:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff946890f63000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121134.359986:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468b99c4000 x1876028970709632/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121134.360041:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970709376:0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.360135:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.360200:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970710016:0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.360234:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.360264:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789121134.360271:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970708736:0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.360304:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.360328:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970709504:0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.360355:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.360387:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970708864:0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.360412:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.360430:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970709760:0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.360467:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.360485:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789121134.360490:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970709248:0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.360511:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.360543:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970709888:0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.360566:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.360612:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970709376 00000100:00100000:3.0:1789121134.360623:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970709376 00000100:00100000:3.0:1789121134.360678:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970708864 00000100:00100000:3.0:1789121134.360689:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970708864 00000100:00100000:3.0:1789121134.360713:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789121134.360723:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970709376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.360787:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970709376:12345-0@lo:400:kworker.0 Request processed in 64us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121134.360796:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789121134.360844:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789121134.360852:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970708864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.360885:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970708864:12345-0@lo:400:kworker.0 Request processed in 34us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121134.360891:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789121134.360909:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970710016 00000100:00100000:3.0:1789121134.360913:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970710016 00000100:00100000:3.0:1789121134.360949:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970709760 00000100:00100000:3.0:1789121134.360952:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970709760 00000100:00100000:3.0:1789121134.360963:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970709248 00000100:00100000:3.0:1789121134.360965:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970709248 00000100:00100000:3.0:1789121134.360976:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970709888 00000100:00100000:3.0:1789121134.360978:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970709888 00000100:00100000:3.0:1789121134.360993:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789121134.361000:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970710016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.361031:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970710016:12345-0@lo:400:kworker.0 Request processed in 32us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121134.361038:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789121134.361050:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789121134.361056:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970709760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.361083:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970709760:12345-0@lo:400:kworker.0 Request processed in 27us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121134.361099:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789121134.361110:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789121134.361116:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970709248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.361145:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970709248:12345-0@lo:400:kworker.0 Request processed in 29us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121134.361151:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789121134.361165:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789121134.361170:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970709888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.361195:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970709888:12345-0@lo:400:kworker.0 Request processed in 26us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121134.361200:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789121134.361219:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970708736 00000100:00100000:3.0:1789121134.361222:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970708736 00000100:00100000:3.0:1789121134.361249:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789121134.361255:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:3646:x1876028970708736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.361286:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:3646:x1876028970708736:12345-0@lo:400:kworker.0 Request processed in 32us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121134.361292:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789121134.361329:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970709504 00000100:00100000:3.0:1789121134.361332:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970709504 00000100:00100000:3.0:1789121134.361363:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789121134.361370:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970709504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.361400:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970709504:12345-0@lo:400:kworker.0 Request processed in 31us (1046us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121134.361407:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789121134.361485:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c5e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970708736:0@lo:400:kworker.0 00010000:00080000:3.0:1789121134.361501:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c6580 x1876028970709504/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789121150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121134.361513:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970709504:0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.361524:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c70c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970709376:0@lo:400:kworker.0 00010000:00080000:3.0:1789121134.361533:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c52c0 x1876028970710016/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121134.361541:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c52c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970710016:0@lo:400:kworker.0 00010000:00080000:3.0:1789121134.361584:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c7840 x1876028970709248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121134.361593:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970709248:0@lo:400:kworker.0 00010000:00080000:3.0:1789121134.361604:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c7c00 x1876028970709888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121134.361612:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970709888:0@lo:400:kworker.0 00000100:00100000:3.0:1789121134.361621:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c6940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970708864:0@lo:400:kworker.0 00010000:00080000:3.0:1789121134.361632:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c5680 x1876028970709760/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121134.361638:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c5680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970709760:0@lo:400:kworker.0 00000100:00080000:3.0:1789121134.361662:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789121134.361667:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789121134.361669:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121134.361692:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970708992:0@lo:8:kworker.0 00000100:00100000:3.0:1789121134.361734:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.361758:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970709120:0@lo:8:kworker.0 00000100:00100000:3.0:1789121134.361784:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.361799:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970709632:0@lo:8:kworker.0 00000100:00100000:3.0:1789121134.361842:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.361872:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970708992 00000100:00100000:3.0:1789121134.361876:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970708992 00000100:00100000:3.0:1789121134.361888:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970709120 00000100:00100000:3.0:1789121134.361889:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970709120 00000100:00100000:3.0:1789121134.361895:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970709632 00000100:00100000:3.0:1789121134.361896:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970709632 00000100:00100000:3.0:1789121134.361904:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789121134.361908:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970708992:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789121134.361935:0:19367:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 584 last 0 00000020:00000080:3.0:1789121134.361966:0:19367:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a83107af 00002000:00100000:3.0:1789121134.361983:0:19367:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9468afd54000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789121134.361987:0:19367:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789121134.361990:0:19367:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789121134.362095:0:19367:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789121134.362124:0:19367:0:(import.c:65:import_set_state_nolock()) ffff9468afd55800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121134.362165:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3643:x1876028970708992:12345-0@lo:8:kworker.0 Request processed in 255us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121134.362172:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789121134.362185:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789121134.362190:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970709120:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789121134.362201:0:19367:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1789121134.378748:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c7480 x1876028970708992/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789121159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121134.378769:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789121134.378783:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789121134.378796:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789121134.378806:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789121134.378812:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a2000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789121134.378866:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789121134.378875:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970708992:0@lo:8:kworker.0 00000004:00080000:1.0:1789121134.379062:0:17879:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x6:0x0] 00000100:00100000:1.0:1789121134.379092:0:17879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17879:1876028970710272:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789121134.379204:0:17879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121134.379245:0:17879:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afc01540 going to sleep for 11 seconds 00000004:00080000:1.0:1789121134.379265:0:17878:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789121134.379396:0:17878:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 584568574233ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789121134.379404:0:17878:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:1.0:1789121134.379933:0:19368:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789121134.379944:0:19368:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789121134.380254:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970710144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789121134.380312:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121134.380613:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970710144 00000100:00100000:1.0:1789121134.380623:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970710144 00000100:00100000:1.0:1789121134.380709:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789121134.380720:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970710144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789121134.380760:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1789121134.380841:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3647:x1876028970710144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121134.380851:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789121134.380904:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946784b2c780 x1876028970710144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789121150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121134.380929:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970710144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789121134.381162:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1789121134.382705:0:17834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:1.0:1789121134.388661:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970710272 00000100:00100000:1.0:1789121134.388687:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970710272 00000100:00100000:3.0:1789121134.389749:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848903c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3643:x1876028970709120:12345-0@lo:8:kworker.0 Request processed in 27549us (27955us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789121134.389764:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789121134.389868:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121134.389875:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789121134.389880:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970709120:0@lo:8:kworker.0 00000100:00100000:2.0:1789121134.395018:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789121134.395037:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784892940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970709632:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789121134.395072:0:19366:0:(ldlm_lib.c:1228:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789121134.395226:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784892940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970709632:12345-0@lo:8:kworker.0 Request processed in 191us (33405us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789121134.395235:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789121134.395268:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789121134.395282:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17879:x1876028970710272:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1789121134.396247:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121134.396257:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789121134.396263:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970709632:0@lo:8:kworker.0 00002000:00080000:2.0:1789121134.401208:0:19366:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:2.0:1789121134.401226:0:19366:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1789121134.401236:0:19366:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:7 to 0x280000401:33) 00002000:00010000:2.0:1789121134.418144:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121134.418164:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca96daf9/0xb74d2367a83107b6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.418188:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1789121134.418194:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121134.418202:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca96daf9/0xb74d2367a83107b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.418225:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca96daf9/0xb74d2367a83107b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.418239:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca96daf9/0xb74d2367a83107b6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.418248:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca96daf9/0xb74d2367a83107b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.418275:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121134.418292:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121134.418300:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca96daf9/0xb74d2367a83107b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.418309:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3ba00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.418322:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca96daf9/0xb74d2367a83107b6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.418334:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca96daf9/0xb74d2367a83107b6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.419035:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca96daf9/0xb74d2367a83107b6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.419047:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca96daf9/0xb74d2367a83107b6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.419072:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.419074:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.419075:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789121134.420088:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121134.420098:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e49f8dbb/0xb74d2367a83107bd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.420116:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1789121134.420120:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121134.420128:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e49f8dbb/0xb74d2367a83107bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.420142:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e49f8dbb/0xb74d2367a83107bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.420152:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e49f8dbb/0xb74d2367a83107bd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.420170:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e49f8dbb/0xb74d2367a83107bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.420202:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121134.420704:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121134.420714:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e49f8dbb/0xb74d2367a83107bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.420725:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3be00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121134.420730:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e49f8dbb/0xb74d2367a83107bd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.420740:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e49f8dbb/0xb74d2367a83107bd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.420764:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e49f8dbb/0xb74d2367a83107bd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.420772:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e49f8dbb/0xb74d2367a83107bd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.420811:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121134.420812:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121134.420814:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789121134.421061:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121134.421067:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000633c2e6c/0xb74d2367a83107c4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.421078:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1789121134.421082:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121134.421087:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000633c2e6c/0xb74d2367a83107c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.421096:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000633c2e6c/0xb74d2367a83107c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.421105:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000633c2e6c/0xb74d2367a83107c4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.421114:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000633c2e6c/0xb74d2367a83107c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.421144:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789121134.422573:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121134.422599:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000633c2e6c/0xb74d2367a83107c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.422614:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121134.422619:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000633c2e6c/0xb74d2367a83107c4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.422631:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000633c2e6c/0xb74d2367a83107c4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.422654:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000633c2e6c/0xb74d2367a83107c4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.422663:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000633c2e6c/0xb74d2367a83107c4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.422685:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121134.422687:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121134.422689:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789121134.422890:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121134.422898:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca46a4c1/0xb74d2367a83107cb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.422923:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1789121134.422928:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121134.422935:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca46a4c1/0xb74d2367a83107cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.422948:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca46a4c1/0xb74d2367a83107cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.422957:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca46a4c1/0xb74d2367a83107cb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.422965:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca46a4c1/0xb74d2367a83107cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.422987:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789121134.424036:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121134.424048:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a83107d2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.424064:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1789121134.424068:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121134.424073:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a83107d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.424084:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a83107d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.424109:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a83107d2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.424116:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a83107d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.424146:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789121134.424754:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789121134.424765:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca46a4c1/0xb74d2367a83107cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.424791:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121134.424796:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca46a4c1/0xb74d2367a83107cb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.424807:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca46a4c1/0xb74d2367a83107cb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.424848:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca46a4c1/0xb74d2367a83107cb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.424857:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca46a4c1/0xb74d2367a83107cb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.424887:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789121134.424891:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a83107d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.424898:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121134.424901:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a83107d2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.424908:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a83107d2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.424918:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a83107d2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.424932:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a83107d2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.424947:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121134.424949:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121134.424951:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.425005:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789121134.425168:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121134.425175:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c8878f/0xb74d2367a83107d9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.425186:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1789121134.425190:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121134.425196:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012c8878f/0xb74d2367a83107d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.425207:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012c8878f/0xb74d2367a83107d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.425217:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012c8878f/0xb74d2367a83107d9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.425225:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012c8878f/0xb74d2367a83107d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.425289:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789121134.426617:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121134.426630:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f8c44d3/0xb74d2367a83107e0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.426650:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=584s v=(0 0) 00010000:00010000:2.0:1789121134.426654:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121134.426661:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f8c44d3/0xb74d2367a83107e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.426675:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f8c44d3/0xb74d2367a83107e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.426684:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f8c44d3/0xb74d2367a83107e0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.426693:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f8c44d3/0xb74d2367a83107e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.427308:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789121134.427320:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012c8878f/0xb74d2367a83107d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.427331:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:3.0:1789121134.427337:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c8878f/0xb74d2367a83107d9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.427488:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012c8878f/0xb74d2367a83107d9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.427511:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012c8878f/0xb74d2367a83107d9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.427579:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012c8878f/0xb74d2367a83107d9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.427851:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121134.427867:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121134.427872:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f8c44d3/0xb74d2367a83107e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.427881:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.427902:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f8c44d3/0xb74d2367a83107e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.427911:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f8c44d3/0xb74d2367a83107e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.427923:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f8c44d3/0xb74d2367a83107e0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.427931:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f8c44d3/0xb74d2367a83107e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.427945:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.427947:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.427984:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121134.428790:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.428802:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bea7ea7/0xb74d2367a83107e7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.428847:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.428852:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.428860:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bea7ea7/0xb74d2367a83107e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.428875:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bea7ea7/0xb74d2367a83107e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.428886:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bea7ea7/0xb74d2367a83107e7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.428895:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bea7ea7/0xb74d2367a83107e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.428917:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789121134.429212:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.429218:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b2516bd/0xb74d2367a83107ee lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.429226:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.429229:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.429234:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b2516bd/0xb74d2367a83107ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.429243:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b2516bd/0xb74d2367a83107ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.429261:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b2516bd/0xb74d2367a83107ee lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.429269:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b2516bd/0xb74d2367a83107ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.429278:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789121134.429714:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.429720:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008008dd0c/0xb74d2367a83107f5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.429730:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.429733:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.429738:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008008dd0c/0xb74d2367a83107f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.429748:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008008dd0c/0xb74d2367a83107f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.429757:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008008dd0c/0xb74d2367a83107f5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.429764:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008008dd0c/0xb74d2367a83107f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.429785:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789121134.430178:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789121134.430187:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bea7ea7/0xb74d2367a83107e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430198:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121134.430202:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bea7ea7/0xb74d2367a83107e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430214:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bea7ea7/0xb74d2367a83107e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430238:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bea7ea7/0xb74d2367a83107e7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430247:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bea7ea7/0xb74d2367a83107e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430269:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121134.430272:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b2516bd/0xb74d2367a83107ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430279:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121134.430282:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b2516bd/0xb74d2367a83107ee lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430302:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b2516bd/0xb74d2367a83107ee lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430311:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b2516bd/0xb74d2367a83107ee lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430318:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b2516bd/0xb74d2367a83107ee lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430328:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121134.430332:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008008dd0c/0xb74d2367a83107f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430339:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121134.430342:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008008dd0c/0xb74d2367a83107f5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430362:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008008dd0c/0xb74d2367a83107f5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430372:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008008dd0c/0xb74d2367a83107f5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430380:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008008dd0c/0xb74d2367a83107f5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.430402:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.430404:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.430406:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121134.430866:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.430873:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81f5557/0xb74d2367a83107fc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.430885:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.430889:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.430896:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b81f5557/0xb74d2367a83107fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.430907:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b81f5557/0xb74d2367a83107fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.430916:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b81f5557/0xb74d2367a83107fc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.430926:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b81f5557/0xb74d2367a83107fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.430946:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121134.431248:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121134.431255:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b81f5557/0xb74d2367a83107fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.431264:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217d600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121134.431268:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81f5557/0xb74d2367a83107fc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.431275:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b81f5557/0xb74d2367a83107fc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.431290:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b81f5557/0xb74d2367a83107fc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.431298:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b81f5557/0xb74d2367a83107fc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.431316:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.431317:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.431319:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121134.431709:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.431715:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310803 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.431725:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.431739:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.431745:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.431755:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.431764:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310803 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.431772:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.431842:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789121134.432169:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.432175:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4db5a03/0xb74d2367a831080a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.432183:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.432186:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.432190:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4db5a03/0xb74d2367a831080a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.432200:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4db5a03/0xb74d2367a831080a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.432209:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4db5a03/0xb74d2367a831080a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.432224:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4db5a03/0xb74d2367a831080a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.432232:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789121134.432594:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121134.432603:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.432612:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468c217c000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.432615:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310803 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.432624:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310803 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.432644:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310803 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.432663:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310803 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.432684:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121134.432688:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4db5a03/0xb74d2367a831080a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.432694:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.432697:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4db5a03/0xb74d2367a831080a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.432705:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4db5a03/0xb74d2367a831080a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.432717:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4db5a03/0xb74d2367a831080a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.432726:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4db5a03/0xb74d2367a831080a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.432737:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.432739:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.432741:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121134.433410:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.433430:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006da8741b/0xb74d2367a8310811 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.433454:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.433457:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.433464:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006da8741b/0xb74d2367a8310811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.433476:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006da8741b/0xb74d2367a8310811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.433485:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006da8741b/0xb74d2367a8310811 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.433493:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006da8741b/0xb74d2367a8310811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.433515:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121134.433988:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121134.433994:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006da8741b/0xb74d2367a8310811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.434011:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.434014:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006da8741b/0xb74d2367a8310811 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.434023:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006da8741b/0xb74d2367a8310811 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.434040:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006da8741b/0xb74d2367a8310811 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.434049:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006da8741b/0xb74d2367a8310811 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.434068:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.434070:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.434072:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121134.434206:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.434213:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4a70428/0xb74d2367a8310818 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.434227:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.434231:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.434236:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b4a70428/0xb74d2367a8310818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.434247:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b4a70428/0xb74d2367a8310818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.434256:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b4a70428/0xb74d2367a8310818 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.434265:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b4a70428/0xb74d2367a8310818 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.434283:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789121134.434722:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.434728:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000398c3428/0xb74d2367a831081f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.434736:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.434740:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.434744:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000398c3428/0xb74d2367a831081f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.434754:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000398c3428/0xb74d2367a831081f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.434774:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000398c3428/0xb74d2367a831081f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.434781:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000398c3428/0xb74d2367a831081f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.434791:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789121134.435086:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121134.435093:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b4a70428/0xb74d2367a8310818 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.435101:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.435106:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4a70428/0xb74d2367a8310818 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.435115:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b4a70428/0xb74d2367a8310818 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.435137:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b4a70428/0xb74d2367a8310818 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.435146:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b4a70428/0xb74d2367a8310818 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.435163:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121134.435167:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000398c3428/0xb74d2367a831081f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.435173:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.435177:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000398c3428/0xb74d2367a831081f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.435185:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000398c3428/0xb74d2367a831081f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.435193:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000398c3428/0xb74d2367a831081f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.435200:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000398c3428/0xb74d2367a831081f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.435209:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.435211:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.435216:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121134.435404:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.435410:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cdc789e/0xb74d2367a8310826 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.435665:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.435670:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.435676:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003cdc789e/0xb74d2367a8310826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.435687:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003cdc789e/0xb74d2367a8310826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.435709:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003cdc789e/0xb74d2367a8310826 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.435717:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003cdc789e/0xb74d2367a8310826 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.435746:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789121134.436207:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.436213:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a831082d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.436223:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.436226:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.436230:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a831082d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.436239:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a831082d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.436247:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a831082d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.436255:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a831082d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.436264:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789121134.437279:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121134.437291:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003cdc789e/0xb74d2367a8310826 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.437304:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.437309:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003cdc789e/0xb74d2367a8310826 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.437318:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003cdc789e/0xb74d2367a8310826 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.437338:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003cdc789e/0xb74d2367a8310826 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.437361:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003cdc789e/0xb74d2367a8310826 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.437384:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121134.437387:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a831082d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.437394:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.437398:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a831082d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.437404:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a831082d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.437435:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a831082d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.437453:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba218ca4/0xb74d2367a831082d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.437468:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.437470:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.437472:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121134.437809:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.437845:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f44c606/0xb74d2367a8310834 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.437859:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.437869:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.437877:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f44c606/0xb74d2367a8310834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.437890:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f44c606/0xb74d2367a8310834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.437901:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f44c606/0xb74d2367a8310834 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.437909:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f44c606/0xb74d2367a8310834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.437928:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789121134.438335:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.438341:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b5fcbb9/0xb74d2367a831083b lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.438352:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.438356:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.438361:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009b5fcbb9/0xb74d2367a831083b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.438371:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009b5fcbb9/0xb74d2367a831083b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.438380:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009b5fcbb9/0xb74d2367a831083b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.438394:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009b5fcbb9/0xb74d2367a831083b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.438407:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789121134.438950:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121134.438960:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f44c606/0xb74d2367a8310834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.438971:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.438975:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f44c606/0xb74d2367a8310834 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.438985:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f44c606/0xb74d2367a8310834 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.439004:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f44c606/0xb74d2367a8310834 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.439012:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f44c606/0xb74d2367a8310834 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.439047:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121134.439051:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009b5fcbb9/0xb74d2367a831083b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.439057:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.439060:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5fcbb9/0xb74d2367a831083b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.439067:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009b5fcbb9/0xb74d2367a831083b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.439077:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009b5fcbb9/0xb74d2367a831083b lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.439085:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009b5fcbb9/0xb74d2367a831083b lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.439099:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.439101:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.439103:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121134.439232:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.439238:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000700461aa/0xb74d2367a8310842 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.439248:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.439252:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.439258:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000700461aa/0xb74d2367a8310842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.439268:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000700461aa/0xb74d2367a8310842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.439277:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000700461aa/0xb74d2367a8310842 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.439285:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000700461aa/0xb74d2367a8310842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.439309:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121134.439462:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121134.439470:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000700461aa/0xb74d2367a8310842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.439491:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121134.439494:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000700461aa/0xb74d2367a8310842 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.439503:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000700461aa/0xb74d2367a8310842 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.439514:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000700461aa/0xb74d2367a8310842 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.439521:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000700461aa/0xb74d2367a8310842 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.439546:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.439547:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.439549:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121134.440096:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.440103:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a8310849 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.440121:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.440124:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.440129:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a8310849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.440140:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a8310849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.440149:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a8310849 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.440157:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a8310849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.440175:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789121134.440603:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121134.440611:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a8310849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.440620:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.440632:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a8310849 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.440642:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a8310849 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.440658:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a8310849 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.440665:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2b70561/0xb74d2367a8310849 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.440687:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.440689:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.440691:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.440872:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789121134.441019:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.441026:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a8310850 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.441034:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.441037:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.441041:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a8310850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.441050:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a8310850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.441068:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a8310850 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.441075:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a8310850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.441124:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789121134.441507:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.441513:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a8310857 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.441533:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.441536:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.441540:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a8310857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.441551:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a8310857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.441558:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a8310857 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.441565:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a8310857 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.441806:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121134.441815:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a8310850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.441889:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.441893:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a8310850 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.441902:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a8310850 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.441919:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a8310850 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.441935:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072de533e/0xb74d2367a8310850 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.441953:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121134.441957:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a8310857 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.441963:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.441966:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a8310857 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.441974:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a8310857 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.441985:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a8310857 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.441992:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.441994:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.441996:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121134.442151:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789121134.442157:0:19366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000942b383b/0xb74d2367a8310857 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789121134.442774:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.442782:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a831085e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.442793:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.442797:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.442802:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a831085e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.442814:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a831085e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.442858:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a831085e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.442866:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a831085e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.442919:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121134.442927:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a831085e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.442935:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121134.442939:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a831085e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.442948:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a831085e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.442973:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a831085e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.442983:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.442985:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.442987:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121134.443093:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789121134.443099:0:19366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009ccb26a/0xb74d2367a831085e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789121134.443654:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.443662:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4adbe0/0xb74d2367a8310865 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.443673:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.443676:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.443682:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e4adbe0/0xb74d2367a8310865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.443693:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e4adbe0/0xb74d2367a8310865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.443703:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e4adbe0/0xb74d2367a8310865 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.443710:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e4adbe0/0xb74d2367a8310865 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.443742:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121134.443748:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e4adbe0/0xb74d2367a8310865 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.443757:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121134.443766:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4adbe0/0xb74d2367a8310865 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.443774:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e4adbe0/0xb74d2367a8310865 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.443789:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e4adbe0/0xb74d2367a8310865 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.443799:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.443800:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121134.443802:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121134.443996:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789121134.444002:0:19366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e4adbe0/0xb74d2367a8310865 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789121134.444515:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789121134.444535:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28ac653/0xb74d2367a831086c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.444558:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=584s v=(0 0) 00010000:00010000:3.0:1789121134.444562:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789121134.444568:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c28ac653/0xb74d2367a831086c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.444577:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c28ac653/0xb74d2367a831086c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.444700:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c28ac653/0xb74d2367a831086c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121134.444711:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c28ac653/0xb74d2367a831086c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.444788:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121134.444795:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c28ac653/0xb74d2367a831086c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.444803:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d1e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121134.444808:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28ac653/0xb74d2367a831086c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.444817:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c28ac653/0xb74d2367a831086c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.444868:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c28ac653/0xb74d2367a831086c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121134.444878:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.444879:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121134.444881:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789121134.445161:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789121134.445175:0:19366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c28ac653/0xb74d2367a831086c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121134.445466:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789121134.445693:0:19366:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:6 00000100:00100000:2.0:1789121134.446038:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17879:x1876028970710272:12345-0@lo:5:osp-pre-0-0.0 Request processed in 50757us (66828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121134.446050:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789121134.446159:0:17879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17879:1876028970710272:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789121134.446180:0:17879:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x6:0x0] 00000100:00100000:1.0:1789121134.446242:0:17879:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17879:1876028970710400:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789121134.446285:0:17879:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121134.446473:0:17879:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afc01540 going to sleep for 11 seconds 00000100:00100000:0.0:1789121134.446649:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970710400 00000100:00100000:0.0:1789121134.446658:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970710400 00000100:00100000:0.0:1789121134.446719:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789121134.446739:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:17879:x1876028970710400:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789121134.446790:0:19368:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:0.0:1789121134.457957:0:19362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:0.0:1789121134.458022:0:19362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789121134.458511:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:17879:x1876028970710400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 11764us (12214us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1789121134.458527:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789121134.458686:0:17879:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1789121134.458697:0:17879:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17879:1876028970710400:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789121134.458722:0:17879:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00000100:00100000:0.0:1789121134.484475:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970710528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121134.484617:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121134.484765:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970710528 00000100:00100000:0.0:1789121134.484773:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970710528 00000100:00100000:0.0:1789121134.484914:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789121134.484926:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970710528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789121134.484957:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789121134.485079:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970710528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 156us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121134.485085:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789121134.485137:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970710528:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121134.485156:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789121134.485161:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970710656:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121134.485185:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.485374:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970710656 00000100:00100000:3.0:1789121134.485378:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970710656 00000100:00100000:3.0:1789121134.485412:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789121134.485420:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970710656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789121134.485464:0:17859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789121134.485503:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d30c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970710656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121134.485527:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789121134.485543:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789121134.485550:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970710784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121134.485586:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121134.485609:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970710784 00000100:00100000:3.0:1789121134.485611:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970710784 00000100:00100000:3.0:1789121134.485628:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789121134.485632:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970710784:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789121134.485650:0:17860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789121134.485684:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848912c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970710784:12345-0@lo:41:osp-pre-1-0.0 Request processed in 50us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121134.485690:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789121134.485722:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970710784:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121134.485750:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970710656:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789121135.058949:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789121135.251543:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789121136.084225:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121137.110574:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789121137.437228:0:20184:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789121137.437234:0:20184:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789121137.437235:0:20184:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:2.0:1789121137.437366:0:20184:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9468aa987000 00000020:01000004:2.0:1789121137.437387:0:20184:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789121137.437406:0:20184:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789121137.437435:0:20184:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff946783c7b490) 00000020:00000080:2.0:1789121137.437459:0:20184:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789121137.476611:0:20184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789121137.478527:0:20184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789121137.478928:0:20184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1789121137.479122:0:20184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789121137.479438:0:20184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789121137.479613:0:20184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789121137.479784:0:20184:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:01000000:2.0:1789121137.481302:0:20184:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789121137.481506:0:20184:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789121137.481521:0:20184:0:(osd_handler.c:8895:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789121137.481532:0:20184:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb74d2367a831087a 00000020:01000004:2.0:1789121137.481539:0:20184:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:2.0:1789121137.481624:0:20184:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.132@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789121137.481628:0:20184:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.132@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789121137.481634:0:20184:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789121137.481664:0:20184:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:2.0:1789121137.481668:0:20184:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.132@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789121137.493387:0:20184:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.132@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789121137.493441:0:20184:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.132@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789121137.493445:0:20184:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789121137.493447:0:20184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789121137.493448:0:20184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121137.493449:0:20184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121137.493450:0:20184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121137.493451:0:20184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121137.493452:0:20184:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789121137.493454:0:20184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121137.493455:0:20184:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789121137.493458:0:20184:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789121137.493460:0:20184:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789121137.493461:0:20184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789121137.493462:0:20184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789121137.493463:0:20184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789121137.493464:0:20184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789121137.493465:0:20184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789121137.493466:0:20184:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789121137.493467:0:20184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789121137.493467:0:20184:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789121137.493496:0:20184:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789121137.493515:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970710912:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789121137.493605:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.493650:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aaee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789121137.493748:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970710912 00000100:00100000:0.0:1789121137.493756:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970710912 00000100:00100000:0.0:1789121137.493816:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789121137.493855:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:20184:x1876028970710912:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789121137.493889:0:17847:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789121137.493892:0:17847:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789121137.493896:0:17847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789121137.494259:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:20184:x1876028970710912:12345-0@lo:253:mount.lustre.0 Request processed in 405us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121137.494267:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789121137.494362:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970710912:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789121137.494374:0:20184:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789121137.494384:0:20184:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789121137.494386:0:20184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789121137.494387:0:20184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789121137.494388:0:20184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789121137.494390:0:20184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789121137.494391:0:20184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789121137.494392:0:20184:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789121137.494393:0:20184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789121137.494394:0:20184:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789121137.494423:0:20184:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9468aa987000 from lustre-OST0001 10000000:01000000:3.0:1789121137.494452:0:20184:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789121137.494454:0:20184:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789121137.494463:0:20184:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff946783ca3490 local copy 00010000:00010000:3.0:1789121137.494472:0:20184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121137.494546:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711040:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121137.494584:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.494610:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aaee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789121137.494700:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970711040 00000100:00100000:0.0:1789121137.494705:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970711040 00000100:00100000:0.0:1789121137.494733:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789121137.494740:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:20184:x1876028970711040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121137.494800:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:20184:x1876028970711040:12345-0@lo:501:mount.lustre.0 Request processed in 60us (214us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789121137.494807:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789121137.494947:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711040:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789121137.494961:0:20184:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.132@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789121137.494978:0:20184:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.132@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789121137.494983:0:20184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121137.494992:0:20184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946899a54400/0xb74d2367a83104d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83104d7 expref: -99 pid: 17833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121137.495018:0:20184:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9468aa987000 10000000:01000000:3.0:1789121137.495023:0:20184:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789121137.495028:0:20184:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789121137.495036:0:20184:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789121137.495040:0:20184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789121137.495043:0:20184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789121137.495066:0:20184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121137.495073:0:20184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121137.495081:0:20184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121137.495091:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789121137.495113:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.495127:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aaee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789121137.495175:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970711168 00000100:00100000:0.0:1789121137.495179:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970711168 00000100:00100000:0.0:1789121137.495206:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789121137.495211:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:20184:x1876028970711168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121137.495221:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121137.495231:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e23800/0xb74d2367a8310888 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310881 expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.495250:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e23800/0xb74d2367a8310888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310881 expref: 22 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.495259:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e23800/0xb74d2367a8310888 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310881 expref: 22 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.495276:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e23800, rc 0) 00000100:00100000:0.0:1789121137.495312:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:20184:x1876028970711168:12345-0@lo:101:mount.lustre.0 Request processed in 100us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121137.495317:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789121137.495422:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121137.495435:0:20184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.495455:0:20184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789121137.496307:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789121137.496913:0:20184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789121137.499314:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789121137.499372:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789121137.499389:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789121137.499400:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789121137.499424:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789121137.499436:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789121137.499457:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789121137.499462:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789121137.499633:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121137.499701:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.499790:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121137.499978:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970711296 00000100:00100000:3.0:1789121137.499985:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970711296 00000100:00100000:3.0:1789121137.500069:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789121137.500078:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:20184:x1876028970711296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789121137.500214:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:20184:x1876028970711296:12345-0@lo:501:mount.lustre.0 Request processed in 137us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121137.500221:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789121137.500282:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121137.500310:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121137.500346:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.500598:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf59c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121137.500733:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970711424 00000100:00100000:0.0:1789121137.500739:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970711424 00000100:00100000:0.0:1789121137.500763:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789121137.500769:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:20184:x1876028970711424:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121137.501570:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:20184:x1876028970711424:12345-0@lo:503:mount.lustre.0 Request processed in 798us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121137.501578:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789121137.502772:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711424:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789121137.503195:0:20184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789121137.503283:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121137.503353:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.503641:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf5d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789121137.503725:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970711552 00000100:00100000:3.0:1789121137.503732:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970711552 00000100:00100000:3.0:1789121137.503815:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789121137.503859:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:20184:x1876028970711552:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121137.504277:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:20184:x1876028970711552:12345-0@lo:502:mount.lustre.0 Request processed in 420us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121137.504296:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789121137.504427:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711552:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789121137.504623:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789121137.504653:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789121137.504672:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789121137.504686:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789121137.504700:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789121137.504715:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789121137.504729:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789121137.504742:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789121137.504753:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789121137.504780:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121137.504852:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.505096:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789121137.505169:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970711680 00000100:00100000:0.0:1789121137.505175:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970711680 00000100:00100000:1.0:1789121137.505329:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789121137.505338:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:20184:x1876028970711680:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789121137.505451:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:20184:x1876028970711680:12345-0@lo:502:mount.lustre.0 Request processed in 114us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121137.505459:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789121137.505523:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789121137.505575:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789121137.505583:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1789121137.506221:0:20188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789121137.506230:0:20188:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1789121137.506236:0:20188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.506238:0:20188:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789121137.506244:0:20188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789121137.506260:0:20188:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9468c0874ed8) 00000020:00000080:2.0:1789121137.506299:0:20188:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789121137.506306:0:20188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789121137.506386:0:20188:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468aa987000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789121137.506395:0:20188:0:(osd_handler.c:8895:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789121137.506403:0:20188:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xb74d2367a8310896 00010000:00010000:2.0:1789121137.514479:0:20188:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1789121137.515143:0:20188:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:3.0:1789121137.516379:0:20188:0:(osd_handler.c:5551:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789121137.518209:0:20188:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789121137.518223:0:20188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121137.518230:0:20188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121137.518232:0:20188:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789121137.518235:0:20188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121137.518238:0:20188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121137.518240:0:20188:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789121137.518242:0:20188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789121137.518244:0:20188:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789121137.518246:0:20188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121137.518248:0:20188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121137.518249:0:20188:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789121137.518251:0:20188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789121137.518253:0:20188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121137.518255:0:20188:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789121137.518257:0:20188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789121137.518276:0:20188:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789121137.518279:0:20188:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789121137.518280:0:20188:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789121137.518283:0:20188:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789121137.519654:0:20184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789121137.519703:0:20184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789121137.519793:0:20184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.519845:0:20184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9467838d1e00/0xb74d2367a8310881 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310888 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121137.519855:0:20184:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468aa987000 from 1 10000000:01000000:2.0:1789121137.519858:0:20184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789121137.519899:0:20184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.519906:0:20184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.519917:0:20184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121137.519941:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711808:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789121137.520016:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.520054:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e13a840 going to sleep for 11 seconds 00000100:00100000:1.0:1789121137.520686:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970711808 00000100:00100000:1.0:1789121137.520695:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970711808 00000100:00100000:1.0:1789121137.520754:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789121137.520764:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:20184:x1876028970711808:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789121137.520779:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121137.520793:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a2c00/0xb74d2367a83108a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a831089d expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.520851:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a2c00/0xb74d2367a83108a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a831089d expref: 23 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.520863:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a2c00/0xb74d2367a83108a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831089d expref: 23 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.520872:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2c00, rc 0) 00000100:00100000:1.0:1789121137.520931:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:20184:x1876028970711808:12345-0@lo:101:mount.lustre.0 Request processed in 168us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121137.520938:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789121137.521568:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711808:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121137.521587:0:20184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.521597:0:20184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789121137.522991:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789121137.523247:0:20184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789121137.523418:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789121137.523449:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789121137.523468:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789121137.523474:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789121137.523539:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121137.523611:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.523657:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a09bfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789121137.523803:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970711936 00000100:00100000:0.0:1789121137.523810:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970711936 00000100:00100000:0.0:1789121137.526724:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789121137.526743:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:20184:x1876028970711936:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121137.526948:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:20184:x1876028970711936:12345-0@lo:501:mount.lustre.0 Request processed in 212us (3337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121137.526956:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789121137.527058:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970711936:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789121137.527103:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712064:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789121137.527151:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.527190:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a09bfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789121137.527233:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970712064 00000100:00100000:0.0:1789121137.527239:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970712064 00000100:00100000:0.0:1789121137.527278:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789121137.527285:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:20184:x1876028970712064:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121137.527365:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:20184:x1876028970712064:12345-0@lo:503:mount.lustre.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121137.527377:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789121137.527452:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712064:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789121137.527890:0:20184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789121137.527958:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121137.527996:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.528015:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887bf5480 going to sleep for 11 seconds 00000100:00100000:0.0:1789121137.528164:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970712192 00000100:00100000:0.0:1789121137.528168:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970712192 00000100:00100000:0.0:1789121137.528199:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789121137.528206:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:20184:x1876028970712192:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121137.528283:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:20184:x1876028970712192:12345-0@lo:502:mount.lustre.0 Request processed in 78us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121137.528290:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789121137.528462:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712192:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789121137.528676:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789121137.528699:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789121137.528710:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789121137.528721:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789121137.528736:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789121137.528764:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789121137.528779:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789121137.528793:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 144 off9680 00000040:00080000:2.0:1789121137.528805:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9904 00000040:00080000:2.0:1789121137.528948:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10128 00000040:00080000:2.0:1789121137.528970:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 144 off10272 00000040:00080000:2.0:1789121137.528989:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10496 00000040:00080000:2.0:1789121137.528999:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10720 00000040:00080000:2.0:1789121137.529012:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 128 off10848 00000040:00080000:2.0:1789121137.529022:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off11072 00000040:00080000:2.0:1789121137.529032:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11296 00000040:00080000:2.0:1789121137.529042:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 128 off11424 00000100:00100000:2.0:1789121137.529065:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712320:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121137.529106:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.529173:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689e13a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789121137.533134:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970712320 00000100:00100000:0.0:1789121137.533146:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970712320 00000100:00100000:0.0:1789121137.533208:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789121137.533216:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:20184:x1876028970712320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121137.533525:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:20184:x1876028970712320:12345-0@lo:502:mount.lustre.0 Request processed in 309us (4417us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121137.533531:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789121137.533670:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712320:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789121137.533885:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11648 00000040:00080000:2.0:1789121137.533902:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 18 count 19 00000020:01000000:2.0:1789121137.535313:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121137.535324:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.535326:0:20192:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789121137.535332:0:20192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9468aa987000 00000020:00000080:2.0:1789121137.535335:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121137.535341:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121137.535343:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.535345:0:20192:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789121137.535347:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121137.535348:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.535350:0:20192:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789121137.535352:0:20192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9468aa987000 00000020:00000080:2.0:1789121137.535354:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121137.535423:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121137.535426:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.535427:0:20192:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789121137.535430:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121137.535432:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.535433:0:20192:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121137.535436:0:20192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468aa987000 00000020:00000080:2.0:1789121137.535444:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121137.536303:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121137.536309:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.536310:0:20192:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre lod.lustre-MDT0000-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121137.536313:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121137.536316:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.536317:0:20192:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121137.536320:0:20192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468aa987000 00000020:00000080:2.0:1789121137.536321:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121137.536339:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121137.536341:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.536342:0:20192:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre lod.lustre-MDT0001-mdtlov.enable_compr_rotational 00000020:01000000:2.0:1789121137.536344:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121137.536347:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.536349:0:20192:0:(obd_config.c:1563:class_process_config()) marker 6 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789121137.536352:0:20192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468aa987000 00000020:00000080:2.0:1789121137.536354:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121137.536369:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121137.536371:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.536373:0:20192:0:(obd_config.c:1563:class_process_config()) marker 6 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789121137.536376:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789121137.536378:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.536379:0:20192:0:(obd_config.c:1563:class_process_config()) marker 7 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789121137.536383:0:20192:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9468aa987000 00000020:00000080:2.0:1789121137.536385:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789121137.536419:0:20192:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789121137.536423:0:20192:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789121137.536424:0:20192:0:(obd_config.c:1563:class_process_config()) marker 7 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789121137.536427:0:20192:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 19 count 19 00000020:01000000:0.0:1789121137.537442:0:20184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-18 (rc=0) 10000000:01000000:0.0:1789121137.537488:0:20184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789121137.537510:0:20184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.537523:0:20184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121137.537580:0:20184:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789121137.537582:0:20184:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9468aa987000 10000000:01000000:0.0:1789121137.537585:0:20184:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9468aa987000 10000000:01000000:0.0:1789121137.537589:0:20184:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789121137.537604:0:20184:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9468aa987000 from 1 10000000:01000000:0.0:1789121137.537606:0:20184:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789121137.537640:0:20184:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.537647:0:20184:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.537658:0:20184:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121137.537679:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712448:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789121137.538980:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121137.539020:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff94688562b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789121137.539288:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970712448 00000100:00100000:2.0:1789121137.539296:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970712448 00000100:00100000:2.0:1789121137.539355:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789121137.539366:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:20184:x1876028970712448:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789121137.539392:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121137.539419:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa990800/0xb74d2367a83108b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83108ab expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.539449:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa990800/0xb74d2367a83108b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83108ab expref: 24 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.539461:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa990800/0xb74d2367a83108b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83108ab expref: 24 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.539471:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa990800, rc 0) 00000100:00100000:2.0:1789121137.539518:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970712448:12345-0@lo:101:mount.lustre.0 Request processed in 154us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121137.539525:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789121137.541606:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712448:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789121137.541637:0:20184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.541651:0:20184:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789121137.546936:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:0.0:1789121137.547505:0:20184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789121137.548006:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789121137.548033:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789121137.548048:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789121137.548061:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789121137.548074:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789121137.548089:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789121137.548102:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789121137.548126:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789121137.548141:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789121137.548155:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789121137.548168:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789121137.548208:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789121137.548223:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789121137.548236:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789121137.548248:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789121137.548260:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789121137.548274:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789121137.548286:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789121137.548314:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789121137.548329:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789121137.548343:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789121137.548356:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789121137.548369:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789121137.548384:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789121137.548397:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1789121137.548422:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1789121137.548437:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1789121137.548465:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1789121137.548479:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1789121137.548492:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1789121137.548506:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1789121137.548524:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1789121137.548534:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1789121137.548542:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1789121137.548549:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1789121137.548940:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1789121137.548957:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1789121137.548967:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1789121137.548975:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:0.0:1789121137.548982:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:0.0:1789121137.549000:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:0.0:1789121137.549008:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:0.0:1789121137.549018:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:0.0:1789121137.549048:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:0.0:1789121137.549068:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:0.0:1789121137.549087:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:0.0:1789121137.549110:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:0.0:1789121137.549114:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:0.0:1789121137.549250:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121137.549362:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121137.549419:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970712576 00000100:00100000:0.0:1789121137.549426:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970712576 00000100:00100000:0.0:1789121137.549487:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789121137.549497:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970712576:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121137.549880:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970712576:12345-0@lo:501:mount.lustre.0 Request processed in 383us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121137.549890:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789121137.549934:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789121137.549957:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789121137.549990:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712704:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789121137.550028:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121137.550051:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789121137.550287:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970712704 00000100:00100000:3.0:1789121137.550292:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970712704 00000100:00100000:3.0:1789121137.550325:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789121137.550331:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970712704:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789121137.550427:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970712704:12345-0@lo:503:mount.lustre.0 Request processed in 95us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121137.550435:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789121137.550644:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712704:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789121137.551199:0:20184:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789121137.551279:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121137.551479:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.551522:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970712832 00000100:00100000:2.0:1789121137.551528:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970712832 00000100:00100000:2.0:1789121137.551563:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1789121137.551571:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970712832:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121137.551766:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789121137.551815:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970712832:12345-0@lo:502:mount.lustre.0 Request processed in 244us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121137.551866:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712832:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789121137.551877:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000040:00080000:0.0:1789121137.552050:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789121137.552076:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789121137.552092:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789121137.552107:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789121137.552120:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789121137.552133:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789121137.552146:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789121137.552158:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789121137.552170:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789121137.553243:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789121137.553470:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789121137.553491:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789121137.553504:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789121137.553516:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789121137.553531:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789121137.553546:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789121137.553879:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789121137.553903:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789121137.553921:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789121137.553942:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789121137.553963:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789121137.553983:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789121137.554003:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789121137.554024:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789121137.554045:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:0.0:1789121137.554066:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:0.0:1789121137.554103:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:0.0:1789121137.554123:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:0.0:1789121137.554142:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:0.0:1789121137.554161:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:0.0:1789121137.554187:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:0.0:1789121137.554199:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:0.0:1789121137.554211:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:0.0:1789121137.554223:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:0.0:1789121137.554236:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:0.0:1789121137.554249:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:0.0:1789121137.554261:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:0.0:1789121137.554273:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:0.0:1789121137.554285:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:0.0:1789121137.554313:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:0.0:1789121137.554328:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:0.0:1789121137.554341:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:0.0:1789121137.554366:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:0.0:1789121137.554380:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:0.0:1789121137.554394:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:0.0:1789121137.554406:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:0.0:1789121137.554433:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:0.0:1789121137.554444:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:0.0:1789121137.554527:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712960:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121137.559523:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121137.559573:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789121137.559815:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970712960 00000100:00100000:3.0:1789121137.559859:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970712960 00000100:00100000:3.0:1789121137.559910:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789121137.559917:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970712960:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121137.560049:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970712960:12345-0@lo:502:mount.lustre.0 Request processed in 131us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121137.560056:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789121137.560084:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970712960:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121137.560422:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:0.0:1789121137.560457:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:0.0:1789121137.560495:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970713088:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789121137.560553:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121137.560590:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a0509e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789121137.560815:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970713088 00000100:00100000:3.0:1789121137.560838:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970713088 00000100:00100000:3.0:1789121137.560877:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789121137.560884:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970713088:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789121137.560962:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970713088:12345-0@lo:502:mount.lustre.0 Request processed in 79us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121137.560969:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789121137.560993:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970713088:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789121137.561039:0:20184:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1789121137.561057:0:20184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1789121137.562743:0:20196:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789121137.562762:0:20196:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9468ab903490) 00000020:00000080:3.0:1789121137.562790:0:20196:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789121137.562888:0:20196:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468aa987000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789121137.562893:0:20196:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468aa987000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789121137.562895:0:20196:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468aa987000 3 00010000:00080000:3.0:1789121137.562922:0:20196:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946782978800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.132@tcp at head 00010000:00010000:3.0:1789121137.564542:0:20196:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789121137.564749:0:20196:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789121137.564792:0:20196:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789121137.564804:0:20196:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xb74d2367a83108c0 00000100:00080000:3.0:1789121137.564815:0:20196:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789121137.564844:0:20196:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff946782978800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121137.564881:0:20196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946784892580 x1876028970713216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121137.564928:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970713216:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789121137.564998:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.565061:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970713216 00000100:00100000:3.0:1789121137.565066:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970713216 00000100:00100000:3.0:1789121137.565093:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789121137.565101:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3643:x1876028970713216:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789121137.565137:0:17855:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:3.0:1789121137.565178:0:17855:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xb74d2367a83108c7 00000004:00100000:3.0:1789121137.565193:0:17855:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789121137.565227:0:17855:0:(import.c:65:import_set_state_nolock()) ffff946782ae9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121137.565275:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3643:x1876028970713216:12345-0@lo:38:llog_process_th.0 Request processed in 174us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121137.565283:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789121137.565319:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946784892580 x1876028970713216/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121137.565328:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789121137.565336:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789121137.565341:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789121137.565346:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789121137.565348:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946782978800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789121137.565355:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3643:1876028970713216:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789121137.565374:0:20196:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789121137.565450:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121137.565455:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789121137.565463:0:37:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121137.565467:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 584 00000100:00080000:3.0:1789121137.565470:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789121137.565476:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9468a08a9800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121137.565493:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946784891e00 x1876028970713600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789121137.565533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121137.565536:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789121137.565537:0:37:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121137.565541:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 584 00000100:00080000:3.0:1789121137.565543:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1789121137.565546:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff946890f63000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121137.565558:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9467848930c0 x1876028970714112/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789121137.565617:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970713344:0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.565653:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.565675:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970713984:0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.565706:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.565727:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789121137.565733:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970713856:0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.565758:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.565774:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970714496:0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.565799:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.565849:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970713472:0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.565892:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.565919:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970714240:0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.565946:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.565964:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789121137.565970:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970713728:0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.565992:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.566007:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970714368:0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.566026:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.566054:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970713344 00000100:00100000:3.0:1789121137.566058:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970713344 00000100:00100000:3.0:1789121137.566088:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970713856 00000100:00100000:3.0:1789121137.566090:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970713856 00000100:00100000:3.0:1789121137.566107:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789121137.566114:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970713344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.566154:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c5680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970713344:12345-0@lo:400:kworker.0 Request processed in 40us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121137.566160:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789121137.566175:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789121137.566181:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970713856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.566207:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970713856:12345-0@lo:400:kworker.0 Request processed in 27us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121137.566213:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789121137.566231:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970713984 00000100:00100000:3.0:1789121137.566234:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970713984 00000100:00100000:3.0:1789121137.566271:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970713472 00000100:00100000:3.0:1789121137.566274:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970713472 00000100:00100000:3.0:1789121137.566296:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789121137.566310:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970713984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.566346:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970713984:12345-0@lo:400:kworker.0 Request processed in 37us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121137.566352:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789121137.566365:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789121137.566371:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970713472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.566400:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c52c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970713472:12345-0@lo:400:kworker.0 Request processed in 29us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121137.566405:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789121137.567893:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970714496 00000100:00100000:2.0:1789121137.567903:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970714496 00000100:00100000:2.0:1789121137.567945:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970714240 00000100:00100000:2.0:1789121137.567947:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970714240 00000100:00100000:2.0:1789121137.567957:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970713728 00000100:00100000:2.0:1789121137.567959:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970713728 00000100:00100000:2.0:1789121137.567968:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970714368 00000100:00100000:2.0:1789121137.567970:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970714368 00000100:00100000:2.0:1789121137.567996:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121137.568003:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970714496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121137.568065:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970714496:12345-0@lo:400:kworker.0 Request processed in 63us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121137.568071:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121137.568084:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789121137.568088:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970714240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121137.568109:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c70c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1876028970714240:12345-0@lo:400:kworker.0 Request processed in 21us (2163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121137.568114:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789121137.568122:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789121137.568126:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970713728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121137.568146:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c6580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970713728:12345-0@lo:400:kworker.0 Request processed in 19us (2154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121137.568151:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789121137.568160:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789121137.568167:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970714368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121137.568202:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c5e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970714368:12345-0@lo:400:kworker.0 Request processed in 37us (2175us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121137.568207:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789121137.568222:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789121137.568225:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789121137.568228:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789121137.573378:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff946784893c00 x1876028970713728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121137.573396:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970713728:0@lo:400:kworker.0 00010000:00080000:3.0:1789121137.573422:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c61c0 x1876028970714368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121137.573430:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c61c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970714368:0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.573445:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970713472:0@lo:400:kworker.0 00010000:00080000:3.0:1789121137.573459:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c4000 x1876028970714240/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121137.573467:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3644:1876028970714240:0@lo:400:kworker.0 00000100:00100000:3.0:1789121137.573504:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970713600:0@lo:8:kworker.0 00000100:00100000:3.0:1789121137.573560:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.573592:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970714112:0@lo:8:kworker.0 00000100:00100000:3.0:1789121137.573608:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121137.573646:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970713600 00000100:00100000:3.0:1789121137.573652:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970713600 00000100:00100000:3.0:1789121137.573673:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970714112 00000100:00100000:3.0:1789121137.573675:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970714112 00000100:00100000:3.0:1789121137.573686:0:20006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789121137.573693:0:20006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1876028970713600:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789121137.573899:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970713856:0@lo:400:kworker.0 00010000:00080000:0.0:1789121137.573914:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468b99c7480 x1876028970714496/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121137.573924:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970714496:0@lo:400:kworker.0 00000100:00100000:0.0:1789121137.573937:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970713344:0@lo:400:kworker.0 00000100:00100000:0.0:1789121137.573950:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970713984:0@lo:400:kworker.0 00000100:00100000:2.0:1789121137.574562:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789121137.574569:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970714112:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789121137.574636:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c61c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970714112:12345-0@lo:8:kworker.0 Request processed in 67us (1026us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789121137.574649:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000020:01000004:2.0:1789121137.575703:0:20196:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789121137.576277:0:20196:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9468c0871a48) 00000020:00000080:2.0:1789121137.576309:0:20196:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:3.0:1789121137.576509:0:20006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3643:x1876028970713600:12345-0@lo:8:kworker.0 Request processed in 2812us (2946us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789121137.576519:0:20006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789121137.576586:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789121137.576595:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121137.576600:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789121137.576603:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970713600:0@lo:8:kworker.0 00000100:00100000:3.0:1789121137.576616:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789121137.576619:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789121137.576622:0:3643:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789121137.576626:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970714112:0@lo:8:kworker.0 00000020:01000004:2.0:1789121137.577928:0:20196:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9468aa987000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789121137.577935:0:20196:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9468aa987000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789121137.577938:0:20196:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9468aa987000 3 00010000:00080000:2.0:1789121137.577978:0:20196:0:(ldlm_lib.c:102:import_set_conn()) imp ffff946783953800@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.132@tcp at head 00010000:00010000:2.0:1789121137.584164:0:20196:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:2.0:1789121137.585012:0:20196:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1789121137.585074:0:20196:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789121137.585087:0:20196:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xb74d2367a83108d5 00000100:00080000:2.0:1789121137.585098:0:20196:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789121137.585105:0:20196:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff946783953800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:2.0:1789121137.585142:0:20196:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9468bf75fc00 x1876028970714624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789121137.585784:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876028970714624:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789121137.585895:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.585958:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970714624 00000100:00100000:2.0:1789121137.585966:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970714624 00000100:00100000:2.0:1789121137.585997:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789121137.586003:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3643:x1876028970714624:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789121137.586029:0:19755:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 587 last 0 00000020:00000080:2.0:1789121137.586065:0:19755:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xb74d2367a83108dc 00000004:00100000:2.0:1789121137.586082:0:19755:0:(mdt_handler.c:7306:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789121137.586121:0:19755:0:(import.c:65:import_set_state_nolock()) ffff946783954800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121137.586300:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3643:x1876028970714624:12345-0@lo:38:llog_process_th.0 Request processed in 295us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121137.586310:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789121137.586500:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9468bf75fc00 x1876028970714624/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789121147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121137.586511:0:3643:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789121137.586520:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1789121137.586527:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789121137.586533:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789121137.586536:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946783953800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789121137.586543:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3643:1876028970714624:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789121137.586567:0:20196:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000040:00080000:2.0:1789121137.586925:0:20196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:1.0:1789121137.587285:0:20184:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789121137.587324:0:20184:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789121137.587430:0:20184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.587440:0:20184:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e23a00/0xb74d2367a83108ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108b2 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789121137.587489:0:20184:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789121137.587492:0:20184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789121137.587493:0:20184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121137.587494:0:20184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121137.587495:0:20184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121137.587497:0:20184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121137.587498:0:20184:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789121137.587499:0:20184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121137.587501:0:20184:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789121137.587505:0:20184:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789121137.587508:0:20184:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789121137.587509:0:20184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789121137.587510:0:20184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121137.587511:0:20184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121137.587512:0:20184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121137.587513:0:20184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121137.587513:0:20184:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789121137.587514:0:20184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121137.587515:0:20184:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789121137.587535:0:20184:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789121137.587552:0:20184:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970714752:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789121137.587603:0:20184:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121137.587624:0:20184:0:(client.c:2715:ptlrpc_set_wait()) set ffff94689d461300 going to sleep for 11 seconds 00000100:00100000:1.0:1789121137.587643:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970714752 00000100:00100000:1.0:1789121137.587648:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970714752 00000100:00100000:1.0:1789121137.587681:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789121137.587688:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970714752:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789121137.587789:0:17847:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789121137.587803:0:17847:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789121137.589448:0:17847:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789121137.589469:0:17847:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789121137.589792:0:17870:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789121137.589797:0:17870:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789121137.589818:0:17870:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.589852:0:17870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a55e00/0xb74d2367a8310793 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831078c expref: 24 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.589860:0:17870:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a55a00/0xb74d2367a83107a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831079a expref: 24 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.589868:0:17870:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.589904:0:17870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a55a00/0xb74d2367a83107a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a831079a expref: 24 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.589935:0:17870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946899a55a00/0xb74d2367a83107a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a831079a expref: 24 pid: 17849 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121137.589951:0:17870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970714880:0@lo:104: 00000100:00100000:2.0:1789121137.590009:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789121137.590058:0:17870:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a55e00/0xb74d2367a8310793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a831078c expref: 24 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.590067:0:17870:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946899a55e00/0xb74d2367a8310793 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a831078c expref: 24 pid: 17849 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121137.590075:0:17870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75d680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970715008:0@lo:104: 00000100:00100000:2.0:1789121137.590095:0:17870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121137.590113:0:17870:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468a09bf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121137.590135:0:17838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970714880 00000100:00100000:2.0:1789121137.590141:0:17838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970714880 00000100:00100000:2.0:1789121137.590173:0:17838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970715008 00000100:00100000:2.0:1789121137.590175:0:17838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970715008 00000100:00100000:2.0:1789121137.590202:0:17838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789121137.590210:0:17838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+4:17870:x1876028970714880:12345-0@lo:104: 00010000:00010000:2.0:1789121137.590222:0:17838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.590271:0:17838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789121137.590278:0:17838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75c780 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+4:17870:x1876028970714880:12345-0@lo:104: Request processed in 69us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121137.590285:0:17838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789121137.590304:0:17837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789121137.590315:0:17837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:17870:x1876028970715008:12345-0@lo:104: 00010000:00010000:1.0:1789121137.590325:0:17837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.590443:0:17837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789121137.590449:0:17837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:17870:x1876028970715008:12345-0@lo:104: Request processed in 137us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121137.590537:0:17837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:1.0:1789121137.590561:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789121137.590567:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.590575:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3a400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121137.590579:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.590587:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121137.590595:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121137.590600:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789121137.590630:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.590647:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789121137.590669:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.590676:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783c3a400/0xb74d2367a831079a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83107a1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.590689:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121137.590693:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.590700:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3b200 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121137.590703:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.590711:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121137.590789:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121137.590791:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:20184:x1876028970714752:12345-0@lo:253:mount.lustre.0 Request processed in 3101us (3184us total) trans 0 rc 0/0 10000000:01000000:1.0:1789121137.590803:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1789121137.590808:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:1.0:1789121137.590847:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.590854:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789121137.590869:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121137.590877:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970715264:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789121137.590878:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783c3b200/0xb74d2367a831078c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310793 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121137.590899:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121137.590902:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121137.590905:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121137.590910:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121137.590917:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970715136:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121137.590951:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121137.591022:0:20184:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2cf00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:20184:1876028970714752:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789121137.591033:0:20184:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789121137.591037:0:20184:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789121137.591038:0:20184:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789121137.591040:0:20184:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789121137.591041:0:20184:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789121137.591042:0:20184:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789121137.591044:0:20184:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789121137.591045:0:20184:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789121137.591047:0:20184:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789121137.591048:0:20184:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789121137.591062:0:20184:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789121137.591716:0:17839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970715264 00000100:00100000:0.0:1789121137.591723:0:17839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970715264 00010000:00010000:0.0:1789121137.591745:0:17839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a55e00/0xb74d2367a8310793 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831078c expref: 24 pid: 17849 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121137.591769:0:17839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970715136 00000100:00100000:0.0:1789121137.591772:0:17839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970715136 00010000:00010000:0.0:1789121137.591783:0:17839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a55a00/0xb74d2367a83107a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831079a expref: 25 pid: 17849 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121137.591796:0:17839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789121137.591802:0:17839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+25:3644:x1876028970715264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789121137.591842:0:17839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121137.591847:0:17839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a55e00/0xb74d2367a8310793 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831078c expref: 25 pid: 17849 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.591856:0:17839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a55e00/0xb74d2367a8310793 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a831078c expref: 25 pid: 17849 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.591875:0:17839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121137.591911:0:17839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+25:3644:x1876028970715264:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121137.591918:0:17839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789121137.591933:0:17839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789121137.591938:0:17839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970715136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789121137.591946:0:17839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121137.591950:0:17839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a55a00/0xb74d2367a83107a1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831079a expref: 24 pid: 17849 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.591958:0:17839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a55a00/0xb74d2367a83107a1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a831079a expref: 24 pid: 17849 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.591969:0:17839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.591976:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789121137.591990:0:17839:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024700313s 00010000:00010000:0.0:1789121137.591994:0:17839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.592010:0:17839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.592017:0:17839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.592025:0:17839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.592031:0:17839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121137.592035:0:17839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.592042:0:17839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.592049:0:17839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121137.592058:0:17839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121137.592088:0:17839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970715136:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121137.592096:0:17839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789121137.592124:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3644:1876028970715264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789121137.592908:0:17870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55a00/0xb74d2367a83107a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a831079a expref: 23 pid: 17849 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121137.592930:0:17870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970714880:0@lo:104: 00010000:00010000:2.0:1789121137.592946:0:17870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55e00/0xb74d2367a8310793 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a831078c expref: 22 pid: 17849 timeout: 687 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121137.592954:0:17870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75d680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17870:1876028970715008:0@lo:104: 00010000:00010000:2.0:1789121137.592972:0:17870:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.592980:0:17870:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.592987:0:17870:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.592993:0:17870:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468aa990200/0xb74d2367a83108e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17870 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121137.593013:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121137.593627:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970715136:0@lo:103:ldlm_bl.0 00000001:00000004:2.0:1789121137.597957:0:20184:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789121137.600745:0:20184:0:(ofd_obd.c:543:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789121137.600756:0:20184:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789121137.600796:0:20184:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789121137.600858:0:20184:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.132@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789121137.600880:0:20184:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1789121137.600900:0:20184:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1789121137.602363:0:20184:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121137.602628:0:20184:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789121138.142482:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1789121138.459032:0:20253:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789121138.459396:0:20253:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1789121138.962618:0:17851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789121138.962628:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9468b9c33800 from 10 10000000:01000000:2.0:1789121138.962635:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789121138.962708:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121138.962725:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121138.962741:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121138.962787:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970715392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789121138.963223:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121138.963278:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887b75000 going to sleep for 11 seconds 00000100:00100000:0.0:1789121138.963341:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970715392 00000100:00100000:0.0:1789121138.963351:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970715392 00000100:00100000:0.0:1789121138.963427:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789121138.963439:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:17851:x1876028970715392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121138.963476:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121138.963510:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946783e22400/0xb74d2367a83108f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83108ea expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121138.963564:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946783e22400/0xb74d2367a83108f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83108ea expref: 23 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121138.963585:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946783e22400/0xb74d2367a83108f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83108ea expref: 23 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121138.963598:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946783e22400, rc 0) 00000100:00100000:0.0:1789121138.963655:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:17851:x1876028970715392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 220us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121138.963664:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789121138.963747:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75fc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970715392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121138.963778:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121138.963794:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121138.963872:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970715520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789121138.963902:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121138.963922:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b336c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121138.963933:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970715520 00000100:00100000:0.0:1789121138.963936:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970715520 00000100:00100000:0.0:1789121138.963957:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789121138.963962:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:17851:x1876028970715520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789121138.964065:0:17849:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789121138.964093:0:17849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789121138.964096:0:17849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:0.0:1789121138.964169:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:17851:x1876028970715520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 204us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121138.964176:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789121138.964209:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970715520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789121138.964373:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789121138.964382:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121138.964390:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa990000/0xb74d2367a83108ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108f1 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789121138.964410:0:17851:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789121138.964411:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff946784ac0800 from 10 10000000:01000000:0.0:1789121138.964414:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789121138.964676:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121138.964691:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121138.964708:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121138.964736:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970715648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789121138.965279:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121138.965735:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9467830e6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789121138.965950:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970715648 00000100:00100000:3.0:1789121138.965961:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970715648 00000100:00100000:3.0:1789121138.966291:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789121138.966308:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:17851:x1876028970715648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121138.966326:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121138.966347:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1200/0xb74d2367a83108ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a83108f8 expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121138.966379:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1200/0xb74d2367a83108ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a83108f8 expref: 24 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121138.966413:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1200/0xb74d2367a83108ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83108f8 expref: 24 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121138.966424:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1200, rc 0) 00000100:00100000:2.0:1789121138.966878:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d3c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970715648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121138.966900:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121138.966909:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121138.967059:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970715776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789121138.974134:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121138.974203:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887b75480 going to sleep for 11 seconds 00000100:00100000:2.0:1789121138.974240:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970715776 00000100:00100000:2.0:1789121138.974251:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970715776 00000100:00100000:2.0:1789121138.974313:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789121138.974323:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+25:17851:x1876028970715776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789121138.974365:0:17847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789121138.974383:0:17847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789121138.974386:0:17847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:2.0:1789121138.974528:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+25:17851:x1876028970715776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 205us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121138.974537:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789121138.974599:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75e1c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970715776:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789121138.974678:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789121138.974691:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121138.974704:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff946783e23600/0xb74d2367a83108f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a83108ff expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121138.978740:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:17851:x1876028970715648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 12422us (13450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121138.981327:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00010000:00010000:2.0:1789121139.154084:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121139.602428:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970715904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121139.602533:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121139.602607:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970715904 00000100:00100000:0.0:1789121139.602618:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970715904 00000100:00100000:0.0:1789121139.602686:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789121139.602697:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970715904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789121139.602737:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789121139.602787:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970715904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121139.602795:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789121139.602839:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121139.602885:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970715904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789121139.603062:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789121139.603073:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970716032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789121139.603107:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121139.603418:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970716032 00000100:00100000:0.0:1789121139.603424:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970716032 00000100:00100000:0.0:1789121139.607758:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789121139.607778:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970716032:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789121139.607815:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789121139.607951:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970716032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 180us (4842us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121139.607959:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789121139.608051:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970716032:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1789121139.608685:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121139.614741:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789121139.614778:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970716160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121139.614901:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121139.614967:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970716160 00000100:00100000:0.0:1789121139.614986:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970716160 00000100:00100000:0.0:1789121139.615049:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789121139.615062:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970716160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789121139.615110:0:17860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789121139.615164:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d2d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970716160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121139.615173:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789121139.615251:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970716160:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789121139.618446:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970716288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789121139.618616:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121139.618690:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970716288 00000100:00100000:1.0:1789121139.618699:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970716288 00000100:00100000:1.0:1789121139.618750:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789121139.618759:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970716288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789121139.618812:0:17859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789121139.618892:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2de00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970716288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 133us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121139.618900:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789121139.618952:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970716288:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789121140.180255:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789121140.691962:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789121141.203950:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.226023:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789121142.678502:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121142.678510:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789121142.678516:0:8921:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121142.678532:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9468a08a9800 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121142.678579:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946784892d00 x1876028970716800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789121142.678622:0:8921:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789121142.678625:0:8921:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789121142.678627:0:8921:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789121142.678633:0:8921:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff946890f63000 using connection 192.168.202.132@tcp/0@lo 00000100:00100000:3.0:1789121142.678645:0:8921:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff946784893c00 x1876028970717312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789121142.679000:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3645:1876028970716416:0@lo:400:kworker.0 00000100:00100000:0.0:1789121142.679077:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121142.679118:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970717056:0@lo:400:kworker.0 00000100:00100000:0.0:1789121142.679147:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121142.679166:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970717696:0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.679311:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970716928:0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.679346:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121142.679379:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970717568:0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.679403:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121142.679439:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970716800:0@lo:8:kworker.0 00000100:00100000:2.0:1789121142.679477:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121142.679498:0:3643:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970717312:0@lo:8:kworker.0 00000100:00100000:2.0:1789121142.679521:0:3643:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121142.679568:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970716416 00000100:00100000:2.0:1789121142.679575:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970716416 00000100:00100000:2.0:1789121142.679638:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789121142.679647:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3645:x1876028970716416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.679693:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3645:x1876028970716416:12345-0@lo:400:kworker.0 Request processed in 47us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121142.679701:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789121142.679734:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970716928 00000100:00100000:2.0:1789121142.679738:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970716928 00000100:00100000:2.0:1789121142.679764:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970717568 00000100:00100000:2.0:1789121142.679767:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970717568 00000100:00100000:2.0:1789121142.679799:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789121142.679806:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970716928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.679877:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1876028970716928:12345-0@lo:400:kworker.0 Request processed in 71us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121142.679883:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789121142.679896:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789121142.679901:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970717568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.679929:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970717568:12345-0@lo:400:kworker.0 Request processed in 28us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121142.679934:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789121142.679956:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970716800 00000100:00100000:2.0:1789121142.679961:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970716800 00000100:00100000:2.0:1789121142.679977:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970717312 00000100:00100000:2.0:1789121142.679980:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970717312 00000100:00100000:2.0:1789121142.679994:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789121142.680000:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970716800:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789121142.680031:0:19366:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:2.0:1789121142.680065:0:19366:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xb74d2367a8310906 00002000:00100000:2.0:1789121142.680088:0:19366:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff946783955800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789121142.680092:0:19366:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1789121142.680095:0:19366:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789121142.680730:0:19366:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789121142.680768:0:19366:0:(import.c:65:import_set_state_nolock()) ffff946783950800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121142.680857:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3643:x1876028970716800:12345-0@lo:8:kworker.0 Request processed in 855us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121142.680867:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789121142.680886:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789121142.680891:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3643:x1876028970717312:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789121142.680911:0:19366:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 592 last 0 00000020:00000080:2.0:1789121142.680933:0:19366:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xb74d2367a831090d 00002000:00100000:2.0:1789121142.680941:0:19366:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff946783954000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211398b ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1789121142.680946:0:19366:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1789121142.680948:0:19366:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789121142.680977:0:19366:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1789121142.680990:0:19366:0:(import.c:65:import_set_state_nolock()) ffff946783950000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121142.681019:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75fc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3643:x1876028970717312:12345-0@lo:8:kworker.0 Request processed in 127us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121142.681026:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789121142.681058:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789121142.681097:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784892580 x1876028970716928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121142.681112:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3644:1876028970716928:0@lo:400:kworker.0 00010000:00080000:2.0:1789121142.681126:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893a7f0c0 x1876028970717568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121142.681152:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970717568:0@lo:400:kworker.0 00000100:00100000:0.0:1789121142.684287:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121142.684385:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3645:1876028970716416:0@lo:400:kworker.0 00000100:00100000:0.0:1789121142.684430:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970716544:0@lo:400:kworker.0 00000100:00100000:0.0:1789121142.684482:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121142.684507:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970717184:0@lo:400:kworker.0 00000100:00100000:0.0:1789121142.684532:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121142.684890:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970717056 00000100:00100000:1.0:1789121142.684897:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970717056 00000100:00100000:1.0:1789121142.684947:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970716544 00000100:00100000:1.0:1789121142.684951:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970716544 00000100:00100000:1.0:1789121142.684969:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789121142.684978:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970717056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121142.685045:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970717056:12345-0@lo:400:kworker.0 Request processed in 68us (5897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121142.685053:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789121142.685071:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789121142.685077:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970716544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121142.685107:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d1e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970716544:12345-0@lo:400:kworker.0 Request processed in 30us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121142.685113:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789121142.685134:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970716672:0@lo:400:kworker.0 00000100:00100000:1.0:1789121142.689753:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970717696 00000100:00100000:1.0:1789121142.689771:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970717696 00000100:00100000:0.0:1789121142.690087:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121142.690122:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970717440:0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.692316:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970717184 00000100:00100000:2.0:1789121142.692330:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970717184 00000100:00100000:0.0:1789121142.692404:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121142.692460:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970717952:0@lo:400:kworker.0 00000100:00100000:0.0:1789121142.692526:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121142.692608:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970717056:0@lo:400:kworker.0 00000100:00100000:0.0:1789121142.692638:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970717824:0@lo:400:kworker.0 00000100:00100000:0.0:1789121142.692668:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121142.692701:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848930c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970716544:0@lo:400:kworker.0 00000100:00100000:0.0:1789121142.694650:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970717440 00000100:00100000:0.0:1789121142.694664:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970717440 00000100:00100000:0.0:1789121142.694720:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970717952 00000100:00100000:0.0:1789121142.694724:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970717952 00000100:00100000:1.0:1789121142.694805:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970717824 00000100:00100000:1.0:1789121142.694809:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970717824 00000100:00100000:2.0:1789121142.700285:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970716672 00000100:00100000:2.0:1789121142.700298:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970716672 00000100:00100000:2.0:1789121142.700330:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789121142.700339:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970717184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.700467:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970717184:12345-0@lo:400:kworker.0 Request processed in 128us (15932us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121142.700475:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789121142.700492:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789121142.700498:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970716672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.700582:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970716672:12345-0@lo:400:kworker.0 Request processed in 83us (10499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121142.700588:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789121142.700618:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789121142.700628:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970717440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.700664:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d03c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970717440:12345-0@lo:400:kworker.0 Request processed in 38us (8264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121142.700670:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789121142.700685:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789121142.700693:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970717696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.700731:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970717696:12345-0@lo:400:kworker.0 Request processed in 39us (16453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121142.700748:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789121142.700773:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789121142.700778:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789121142.700780:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:2.0:1789121142.700816:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893a7f840 x1876028970717696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121142.700851:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970717696:0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.700889:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970716672:0@lo:400:kworker.0 00010000:00080000:2.0:1789121142.700906:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893a7e940 x1876028970717440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121142.700915:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970717440:0@lo:400:kworker.0 00000100:00100000:2.0:1789121142.700947:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970717184:0@lo:400:kworker.0 00010000:00080000:2.0:1789121142.701977:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784892d00 x1876028970716800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789121167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789121142.701996:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789121142.702006:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789121142.702013:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789121142.702018:0:3643:0:(import.c:65:import_set_state_nolock()) ffff9468a08a9800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789121142.702049:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789121142.702055:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3643:1876028970716800:0@lo:8:kworker.0 00010000:00080000:2.0:1789121142.702071:0:3643:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784893c00 x1876028970717312/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789121167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789121142.702080:0:3643:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1789121142.702093:0:3643:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789121142.702096:0:3643:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789121142.702098:0:3643:0:(import.c:65:import_set_state_nolock()) ffff946890f63000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789121142.702110:0:3643:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789121142.702114:0:3643:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784893c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3643:1876028970717312:0@lo:8:kworker.0 00000004:00080000:2.0:1789121142.702153:0:18601:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789121142.702297:0:18601:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 592891475522ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789121142.702305:0:18601:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789121142.702569:0:17881:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:2.0:1789121142.702591:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17881:1876028970718208:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789121142.702649:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121142.702674:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aaef00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121142.702688:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf75d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970718080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789121142.702713:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121142.702748:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970718208 00000100:00100000:2.0:1789121142.702755:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970718208 00000100:00100000:2.0:1789121142.702803:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789121142.702811:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17881:x1876028970718208:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1789121142.703046:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789121142.703083:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970718080 00000100:00100000:2.0:1789121142.703087:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970718080 00000100:00100000:2.0:1789121142.703118:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789121142.703125:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784892d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876028970718080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789121142.703144:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789121142.703189:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784892d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3644:x1876028970718080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121142.703196:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000004:00080000:2.0:1789121142.703297:0:18602:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1789121142.703312:0:18602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18602:1876028970718464:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1789121142.703337:0:18602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121142.703352:0:18602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aaec00 going to sleep for 11 seconds 00000100:00100000:0.0:1789121142.704977:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789121142.704989:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970717952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121142.705072:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970717952:12345-0@lo:400:kworker.0 Request processed in 85us (12544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121142.705079:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789121142.705125:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893a7f480 x1876028970717952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121142.705140:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970717952:0@lo:400:kworker.0 00000100:00100000:1.0:1789121142.705329:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789121142.705338:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970717824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121142.705391:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d12c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970717824:12345-0@lo:400:kworker.0 Request processed in 55us (12722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121142.705398:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789121142.705435:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946893a7e1c0 x1876028970717824/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121142.705445:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7e1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970717824:0@lo:400:kworker.0 00000100:00100000:3.0:1789121142.706051:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970718464 00000100:00100000:3.0:1789121142.706059:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970718464 00000100:00100000:3.0:1789121142.706101:0:20006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789121142.706108:0:20006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18602:x1876028970718464:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:3.0:1789121142.706165:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970718336:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1789121142.706289:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789121142.706445:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121142.706653:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970718336 00000100:00100000:0.0:1789121142.706658:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970718336 00000100:00100000:0.0:1789121142.706685:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789121142.706692:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876028970718336:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789121142.706707:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121142.706751:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1876028970718336:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121142.706769:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789121142.706812:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9467848921c0 x1876028970718336/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789121158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121142.706850:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970718336:0@lo:13:osp-pre-1-1.0 00010000:00080000:3.0:1789121142.707530:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf75d680 x1876028970718080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789121158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121142.707680:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75d680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970718080:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1789121142.708882:0:19366:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:0.0:1789121142.708892:0:19366:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789121142.708899:0:19366:0:(ofd_dev.c:1505:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:33) 00000004:00080000:2.0:1789121142.713513:0:17880:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789121142.713692:0:17880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 592902870402ns, next at 0ns, rc = 0 00080000:00080000:2.0:1789121142.713701:0:17880:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00002000:00080000:3.0:1789121142.719259:0:20006:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1789121142.719271:0:20006:0:(ofd_dev.c:1222:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:3.0:1789121142.719385:0:20006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18602:x1876028970718464:12345-0@lo:7:osp-pre-1-1.0 Request processed in 13272us (16041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121142.719397:0:20006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1789121142.720851:0:18590:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00080000:2.0:1789121142.720916:0:18602:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784891e00 x1876028970718464/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789121158 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121142.720932:0:18602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18602:1876028970718464:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1789121142.720945:0:18602:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789121142.720991:0:18602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18602:1876028970718592:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789121142.721043:0:18602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121142.721074:0:18602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aaec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121142.721097:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970718592 00000100:00100000:2.0:1789121142.721103:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970718592 00000100:00100000:2.0:1789121142.721146:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789121142.721155:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18602:x1876028970718592:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789121142.721198:0:19367:0:(ofd_dev.c:1654:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:2.0:1789121142.721235:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:18602:x1876028970718592:12345-0@lo:5:osp-pre-1-1.0 Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121142.721241:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1789121142.721268:0:18602:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946784891e00 x1876028970718592/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789121158 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121142.721278:0:18602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18602:1876028970718592:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1789121142.721301:0:18602:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:2.0:1789121142.721325:0:18602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18602:1876028970718720:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1789121142.721349:0:18602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121142.721376:0:18602:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6aaec00 going to sleep for 11 seconds 00000100:00100000:2.0:1789121142.721389:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970718720 00000100:00100000:2.0:1789121142.721393:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970718720 00000100:00100000:2.0:1789121142.721415:0:20006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789121142.721421:0:20006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784892580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:18602:x1876028970718720:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1789121142.721448:0:20006:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00002000:00010000:0.0:1789121142.729274:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.729287:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310914 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.729306:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.729311:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.729317:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.729336:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.729346:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310914 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.729354:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.729384:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789121142.729881:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.729888:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831091b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.729898:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.729902:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.729906:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831091b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.729915:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831091b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.729923:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831091b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.729931:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831091b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.729945:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789121142.730323:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121142.730330:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.730339:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.730345:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310914 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.730380:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310914 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.730397:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310914 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.730404:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310914 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.730421:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121142.730425:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831091b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.730431:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.730434:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831091b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.730441:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831091b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.730450:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831091b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.730457:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831091b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.730482:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.730484:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.730485:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.730733:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121142.731777:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121142.731787:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adbada76/0xb74d2367a8310922 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.731803:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=592s v=(0 0) 00010000:00010000:1.0:1789121142.731808:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121142.731814:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adbada76/0xb74d2367a8310922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.731849:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adbada76/0xb74d2367a8310922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.731859:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adbada76/0xb74d2367a8310922 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.731867:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adbada76/0xb74d2367a8310922 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.731897:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121142.733342:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121142.733355:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adbada76/0xb74d2367a8310922 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.733377:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.733382:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adbada76/0xb74d2367a8310922 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.733394:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adbada76/0xb74d2367a8310922 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.733418:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adbada76/0xb74d2367a8310922 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.733425:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adbada76/0xb74d2367a8310922 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.733448:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.733449:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.733451:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121142.733888:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121142.733897:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310929 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.733913:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=592s v=(0 0) 00010000:00010000:1.0:1789121142.733917:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121142.733923:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310929 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.733935:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310929 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.733944:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310929 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.733952:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310929 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.733969:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789121142.733979:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121142.733983:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310929 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.733991:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121142.734008:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310929 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.734015:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310929 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.734027:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310929 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.734034:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310929 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.734048:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.734050:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.734052:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789121142.740283:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121142.740298:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8873317/0xb74d2367a8310930 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.740315:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1789121142.740320:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121142.740327:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a8873317/0xb74d2367a8310930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.740344:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a8873317/0xb74d2367a8310930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.740355:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a8873317/0xb74d2367a8310930 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.740374:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a8873317/0xb74d2367a8310930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.740420:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789121142.740640:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121142.740647:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a8873317/0xb74d2367a8310930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.740656:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121142.740661:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8873317/0xb74d2367a8310930 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.740671:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a8873317/0xb74d2367a8310930 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.740689:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a8873317/0xb74d2367a8310930 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.740703:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a8873317/0xb74d2367a8310930 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.740722:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.740725:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.740726:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789121142.742735:0:17834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789121142.746298:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121142.746312:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310937 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.746329:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=592s v=(0 0) 00010000:00010000:1.0:1789121142.746333:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121142.746340:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.746353:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.746374:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310937 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.746381:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.746449:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789121142.749665:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.749681:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a831093e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.749712:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.749718:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.749725:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a831093e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.749741:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a831093e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.749752:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a831093e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.749761:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a831093e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.753896:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121142.753912:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.753927:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121142.753932:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310937 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.753944:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310937 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.753967:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310937 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.753974:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0e4838c/0xb74d2367a8310937 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.753992:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121142.753995:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a831093e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.754001:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121142.754004:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a831093e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.754019:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a831093e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.754029:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a831093e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.754037:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121142.754038:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121142.754040:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.756616:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789121142.756630:0:19366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a831093e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.757062:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121142.760085:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.760097:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a8310945 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.760114:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.760120:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.760126:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a8310945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.760154:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a8310945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.760164:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a8310945 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.760171:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a8310945 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.760195:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121142.760206:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121142.760212:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a8310945 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.760219:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.760224:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a8310945 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.760233:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a8310945 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.760251:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a8310945 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.760259:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a8310945 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.760283:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.760285:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.760286:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789121142.762510:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121142.762524:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f59429e1/0xb74d2367a831094c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.762539:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1789121142.762543:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121142.762549:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f59429e1/0xb74d2367a831094c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.762561:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f59429e1/0xb74d2367a831094c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.762569:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f59429e1/0xb74d2367a831094c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.762577:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f59429e1/0xb74d2367a831094c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.762613:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789121142.763091:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121142.763098:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fcb473f/0xb74d2367a8310953 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.763108:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1789121142.763112:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121142.763116:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005fcb473f/0xb74d2367a8310953 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.763125:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005fcb473f/0xb74d2367a8310953 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.763133:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005fcb473f/0xb74d2367a8310953 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.763140:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005fcb473f/0xb74d2367a8310953 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.763153:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789121142.763600:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121142.763607:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a831095a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.763616:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1789121142.763625:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121142.763630:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a831095a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.763639:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a831095a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.763647:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a831095a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.763654:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a831095a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.763661:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000001:00080000:2.0:1789121142.764079:0:20185:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1789121142.764097:0:20185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789121142.764101:0:20185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1789121142.764150:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121142.764156:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8310961 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.764165:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1789121142.764168:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121142.764172:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8310961 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.764263:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8310961 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.764279:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8310961 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.764288:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8310961 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.764299:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1789121142.764606:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121142.764612:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002780039a/0xb74d2367a8310968 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.764621:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1789121142.764624:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121142.764628:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002780039a/0xb74d2367a8310968 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.764638:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002780039a/0xb74d2367a8310968 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.764645:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002780039a/0xb74d2367a8310968 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.764654:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002780039a/0xb74d2367a8310968 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.764674:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:0.0:1789121142.764961:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789121142.764969:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f59429e1/0xb74d2367a831094c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.764978:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.764982:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f59429e1/0xb74d2367a831094c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.764992:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f59429e1/0xb74d2367a831094c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765013:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f59429e1/0xb74d2367a831094c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765021:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f59429e1/0xb74d2367a831094c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765038:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789121142.765042:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005fcb473f/0xb74d2367a8310953 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765048:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.765058:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005fcb473f/0xb74d2367a8310953 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765066:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005fcb473f/0xb74d2367a8310953 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765077:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005fcb473f/0xb74d2367a8310953 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765083:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005fcb473f/0xb74d2367a8310953 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765097:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789121142.765100:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a831095a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765107:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.765110:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a831095a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765117:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a831095a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765125:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a831095a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765132:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ec6ea50/0xb74d2367a831095a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765152:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121142.765156:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8310961 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765161:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.765164:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8310961 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765172:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8310961 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765196:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8310961 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765203:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a277487/0xb74d2367a8310961 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765214:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121142.765217:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002780039a/0xb74d2367a8310968 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765223:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.765226:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002780039a/0xb74d2367a8310968 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765245:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002780039a/0xb74d2367a8310968 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765256:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002780039a/0xb74d2367a8310968 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765263:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002780039a/0xb74d2367a8310968 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.765276:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.765278:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.765280:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.765289:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121142.765441:0:20006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784892580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:18602:x1876028970718720:12345-0@lo:5:osp-pre-1-1.0 Request processed in 44016us (44087us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789121142.765453:0:20006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789121142.765520:0:18602:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789121142.765529:0:18602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:18602:1876028970718720:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789121142.765547:0:18602:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789121142.765602:0:18602:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d2580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18602:1876028970718848:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789121142.765645:0:18602:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121142.765674:0:18602:0:(client.c:2715:ptlrpc_set_wait()) set ffff946782b29c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789121142.765701:0:17866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970718848 00000100:00100000:0.0:1789121142.765708:0:17866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970718848 00000100:00100000:0.0:1789121142.765751:0:17866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789121142.765766:0:17866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18602:x1876028970718848:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789121142.765816:0:17866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:18602:x1876028970718848:12345-0@lo:900:osp-pre-1-1.0 Request processed in 51us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121142.765848:0:17866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789121142.765880:0:18602:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d2580 x1876028970718848/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789121158 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121142.765890:0:18602:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d2580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:18602:1876028970718848:0@lo:900:osp-pre-1-1.0 00002000:00010000:2.0:1789121142.766258:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789121142.766266:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78f7b1f/0xb74d2367a831096f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.766278:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=592s v=(0 0) 00010000:00010000:2.0:1789121142.766283:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121142.766289:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a78f7b1f/0xb74d2367a831096f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.766301:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a78f7b1f/0xb74d2367a831096f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.766310:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a78f7b1f/0xb74d2367a831096f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.766318:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a78f7b1f/0xb74d2367a831096f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.766341:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121142.767174:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121142.767194:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a78f7b1f/0xb74d2367a831096f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.767205:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.767209:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78f7b1f/0xb74d2367a831096f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.767219:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a78f7b1f/0xb74d2367a831096f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.767241:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a78f7b1f/0xb74d2367a831096f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.767249:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a78f7b1f/0xb74d2367a831096f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.767268:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.767271:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.767281:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789121142.772250:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121142.772265:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a1077e9/0xb74d2367a8310976 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.772283:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=592s v=(0 0) 00010000:00010000:1.0:1789121142.772289:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121142.772295:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a1077e9/0xb74d2367a8310976 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.772309:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a1077e9/0xb74d2367a8310976 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.772318:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a1077e9/0xb74d2367a8310976 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.772325:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a1077e9/0xb74d2367a8310976 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.772352:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789121142.773020:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121142.773028:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831097d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.773038:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=592s v=(0 0) 00010000:00010000:1.0:1789121142.773041:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121142.773045:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831097d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.773070:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831097d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.773079:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831097d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.773086:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831097d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.773100:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789121142.776670:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789121142.776689:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2250ec/0xb74d2367a8310984 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.776710:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=592s v=(0 0) 00010000:00010000:1.0:1789121142.776715:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121142.776721:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f2250ec/0xb74d2367a8310984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.776735:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f2250ec/0xb74d2367a8310984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.776745:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f2250ec/0xb74d2367a8310984 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.776764:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f2250ec/0xb74d2367a8310984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.776775:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789121142.778275:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789121142.778290:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a1077e9/0xb74d2367a8310976 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778304:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.778308:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a1077e9/0xb74d2367a8310976 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778319:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a1077e9/0xb74d2367a8310976 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778340:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a1077e9/0xb74d2367a8310976 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778348:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a1077e9/0xb74d2367a8310976 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778385:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789121142.778390:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831097d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778397:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.778401:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831097d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778408:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831097d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778430:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831097d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778437:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f48a5ad2/0xb74d2367a831097d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778457:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121142.778461:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f2250ec/0xb74d2367a8310984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778467:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121142.778471:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2250ec/0xb74d2367a8310984 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778478:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f2250ec/0xb74d2367a8310984 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778488:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f2250ec/0xb74d2367a8310984 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778494:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f2250ec/0xb74d2367a8310984 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.778505:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.778517:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.778525:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121142.778534:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121142.780091:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.780104:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831098b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.780121:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.780126:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.780133:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831098b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.780146:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831098b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.780155:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831098b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.780162:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831098b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.780178:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789121142.780667:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121142.780675:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831098b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.780684:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23400 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121142.780689:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831098b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.780698:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831098b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.780717:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831098b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.780725:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b958dbb8/0xb74d2367a831098b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.780746:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.780748:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.780750:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121142.780880:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.780886:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310992 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.780897:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.780901:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.780906:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.780925:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.780934:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310992 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.780942:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310992 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.780958:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789121142.781237:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121142.781249:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310992 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.781256:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121142.781259:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310992 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.781266:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310992 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.781277:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310992 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.781285:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6d0c8fd/0xb74d2367a8310992 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.781298:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.781299:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.781301:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121142.781385:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.781390:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310999 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.781400:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.781403:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.781408:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.781418:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.781426:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310999 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.781446:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.781464:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789121142.781794:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.781800:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f41b891/0xb74d2367a83109a0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.781810:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.781813:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.781817:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f41b891/0xb74d2367a83109a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.781864:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f41b891/0xb74d2367a83109a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.781872:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f41b891/0xb74d2367a83109a0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.781879:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f41b891/0xb74d2367a83109a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.781891:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789121142.782143:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.782149:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008add1ab3/0xb74d2367a83109a7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.782163:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.782167:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.782171:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008add1ab3/0xb74d2367a83109a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.782181:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008add1ab3/0xb74d2367a83109a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.782189:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008add1ab3/0xb74d2367a83109a7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.782197:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008add1ab3/0xb74d2367a83109a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.782206:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1789121142.782435:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789121142.782442:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782451:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121142.782461:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310999 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782470:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310999 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782484:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310999 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782492:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a316493c/0xb74d2367a8310999 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782567:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121142.782572:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f41b891/0xb74d2367a83109a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782577:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121142.782580:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f41b891/0xb74d2367a83109a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782587:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f41b891/0xb74d2367a83109a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782597:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f41b891/0xb74d2367a83109a0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782604:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f41b891/0xb74d2367a83109a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782624:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121142.782627:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008add1ab3/0xb74d2367a83109a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782633:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121142.782636:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008add1ab3/0xb74d2367a83109a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782643:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008add1ab3/0xb74d2367a83109a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782652:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008add1ab3/0xb74d2367a83109a7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782660:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008add1ab3/0xb74d2367a83109a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.782671:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121142.782673:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121142.782674:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121142.782793:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.782799:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f1c3ceb/0xb74d2367a83109ae lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.782807:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.782811:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.782815:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f1c3ceb/0xb74d2367a83109ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.782873:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f1c3ceb/0xb74d2367a83109ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.782892:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f1c3ceb/0xb74d2367a83109ae lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.782900:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f1c3ceb/0xb74d2367a83109ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.782912:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789121142.783154:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121142.783161:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f1c3ceb/0xb74d2367a83109ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.783169:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e23000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121142.783173:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f1c3ceb/0xb74d2367a83109ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.783192:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f1c3ceb/0xb74d2367a83109ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.783204:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f1c3ceb/0xb74d2367a83109ae lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.783210:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f1c3ceb/0xb74d2367a83109ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121142.783225:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.783226:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121142.783228:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121142.783291:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789121142.783533:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.783540:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a6558f/0xb74d2367a83109b5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.783549:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.783553:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.783558:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072a6558f/0xb74d2367a83109b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.783567:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072a6558f/0xb74d2367a83109b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.783575:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072a6558f/0xb74d2367a83109b5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.783583:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072a6558f/0xb74d2367a83109b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.783612:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789121142.783982:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.783989:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c346d20/0xb74d2367a83109bc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.783999:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.784002:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.784006:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c346d20/0xb74d2367a83109bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784016:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c346d20/0xb74d2367a83109bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784024:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c346d20/0xb74d2367a83109bc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784032:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c346d20/0xb74d2367a83109bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784043:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1789121142.784290:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.784296:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa07192f/0xb74d2367a83109c3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784303:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.784312:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.784317:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa07192f/0xb74d2367a83109c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784327:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa07192f/0xb74d2367a83109c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784336:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aa07192f/0xb74d2367a83109c3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784343:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aa07192f/0xb74d2367a83109c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784351:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1789121142.784669:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.784676:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a83109ca lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784685:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.784689:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.784693:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a83109ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784702:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a83109ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784710:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a83109ca lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784725:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a83109ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.784735:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1789121142.785033:0:19366:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789121142.785039:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003780c61e/0xb74d2367a83109d1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.785047:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=592s v=(0 0) 00010000:00010000:0.0:1789121142.785050:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121142.785054:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003780c61e/0xb74d2367a83109d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.785063:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003780c61e/0xb74d2367a83109d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.785070:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003780c61e/0xb74d2367a83109d1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.785077:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003780c61e/0xb74d2367a83109d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121142.785085:0:19366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:0.0:1789121142.785115:0:19366:0:(ofd_dev.c:1532:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:0.0:1789121142.785219:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17881:x1876028970718208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 82404us (82565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121142.785236:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789121142.785298:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf75cf00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17881:1876028970718208:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789121142.785316:0:17881:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:0.0:1789121142.785370:0:17881:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d2580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17881:1876028970718976:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1789121142.785408:0:17881:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121142.785428:0:17881:0:(client.c:2715:ptlrpc_set_wait()) set ffff946887b75540 going to sleep for 11 seconds 00000100:00100000:0.0:1789121142.785447:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970718976 00000100:00100000:0.0:1789121142.785453:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970718976 00000100:00100000:0.0:1789121142.785487:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789121142.785496:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468938e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17881:x1876028970718976:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1789121142.785543:0:19366:0:(ofd_dev.c:1761:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00010000:00010000:2.0:1789121142.785863:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789121142.785874:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072a6558f/0xb74d2367a83109b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.785884:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22a00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121142.785897:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a6558f/0xb74d2367a83109b5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.785907:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072a6558f/0xb74d2367a83109b5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.785926:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072a6558f/0xb74d2367a83109b5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.785933:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072a6558f/0xb74d2367a83109b5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.785955:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789121142.785958:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c346d20/0xb74d2367a83109bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.785964:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22800 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121142.785967:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c346d20/0xb74d2367a83109bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.785974:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c346d20/0xb74d2367a83109bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.785983:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c346d20/0xb74d2367a83109bc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.785990:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c346d20/0xb74d2367a83109bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786011:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789121142.786015:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aa07192f/0xb74d2367a83109c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786021:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121142.786025:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa07192f/0xb74d2367a83109c3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786033:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aa07192f/0xb74d2367a83109c3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786044:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aa07192f/0xb74d2367a83109c3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786052:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa07192f/0xb74d2367a83109c3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786064:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789121142.786068:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a83109ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786074:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783e22600 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121142.786077:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a83109ca lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786097:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a83109ca lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786107:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a83109ca lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786115:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eddf95e5/0xb74d2367a83109ca lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786130:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789121142.786133:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003780c61e/0xb74d2367a83109d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786140:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55e00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121142.786143:0:17843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003780c61e/0xb74d2367a83109d1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786151:0:17843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003780c61e/0xb74d2367a83109d1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786161:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003780c61e/0xb74d2367a83109d1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786169:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003780c61e/0xb74d2367a83109d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121142.786192:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121142.786194:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121142.786196:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789121142.786204:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121142.789325:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468938e83c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17881:x1876028970718976:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3822us (3908us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789121142.789341:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121142.789596:0:17881:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d2580 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17881:1876028970718976:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789121142.789614:0:17881:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:2.0:1789121143.251191:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789121143.620418:0:20543:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg232-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789121144.278537:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789121144.622191:0:20595:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789121144.622783:0:20595:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1789121144.724059:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946889570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970719232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121144.724178:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121144.724235:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789121144.724243:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970719104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121144.724278:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121144.724323:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970719232 00000100:00100000:0.0:1789121144.724333:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970719232 00000100:00100000:0.0:1789121144.724422:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789121144.724444:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946889573840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970719232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789121144.724485:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789121144.724535:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946889573840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970719232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121144.724543:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789121144.724572:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970719104 00000100:00100000:0.0:1789121144.724576:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970719104 00000100:00100000:0.0:1789121144.724609:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789121144.724618:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf705e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970719104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789121144.724648:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789121144.724682:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf705e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970719104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121144.724688:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789121144.724708:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121144.724757:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970719104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121144.724774:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946889570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970719232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121144.726047:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970719360:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121144.726121:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121144.726286:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970719360 00000100:00100000:3.0:1789121144.726293:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970719360 00000100:00100000:3.0:1789121144.726376:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789121144.726386:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970719360:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789121144.726410:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789121144.726457:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7070c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970719360:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121144.726464:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789121144.726518:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970719360:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789121144.726696:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121144.731851:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789121144.731894:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970719488:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121144.732008:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121144.732115:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970719488 00000100:00100000:1.0:1789121144.732127:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970719488 00000100:00100000:1.0:1789121144.732195:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789121144.732208:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970719488:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789121144.732259:0:17859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789121144.732892:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970719488:12345-0@lo:41:osp-pre-1-0.0 Request processed in 682us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121144.732901:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789121144.745597:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970719488:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789121145.300407:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789121145.491374:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1789121145.774720:0:20645:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789121145.776769:0:20645:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789121146.026245:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121146.027317:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947556480 00000100:00100000:3.0:1789121146.027343:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947556480 00000100:00100000:3.0:1789121146.027411:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:3.0:1789121146.027422:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2408:x1876028947556480:12345-192.168.202.32@tcp:250:mount.lustre.0 00010000:00080000:3.0:1789121146.028183:0:17849:0:(ldlm_lib.c:1482:target_handle_connect()) MGS: connection from d42aa198-48db-4e57-bdde-271b173b12cf@192.168.202.32@tcp t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:3.0:1789121146.028227:0:17849:0:(genops.c:1385:class_connect()) connect: client d42aa198-48db-4e57-bdde-271b173b12cf, cookie 0xb74d2367a83109d8 00000100:00080000:3.0:1789121146.028441:0:17849:0:(import.c:65:import_set_state_nolock()) ffff946782aef000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121146.029344:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+5:2408:x1876028947556480:12345-192.168.202.32@tcp:250:mount.lustre.0 Request processed in 1907us (3099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.029358:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 114 00000100:00100000:0.0:1789121146.038182:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121146.038352:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947556608 00000100:00100000:2.0:1789121146.038367:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947556608 00000100:00100000:2.0:1789121146.038450:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:2.0:1789121146.038461:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+5:15195:x1876028947556608:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789121146.038483:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121146.038508:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa990e00/0xb74d2367a83109df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7edc8 expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121146.038544:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa990e00/0xb74d2367a83109df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edc8 expref: 6 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121146.038558:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa990e00/0xb74d2367a83109df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edc8 expref: 6 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121146.038568:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa990e00, rc 0) 00000100:00100000:2.0:1789121146.038645:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+6:15195:x1876028947556608:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 186us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121146.038672:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 115 00000100:00100000:2.0:1789121146.041164:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121146.041322:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947556736 00000100:00100000:3.0:1789121146.041342:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947556736 00000100:00100000:3.0:1789121146.042228:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:3.0:1789121146.042245:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+6:15195:x1876028947556736:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789121146.042423:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+6:15195:x1876028947556736:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 182us (1273us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789121146.042433:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 116 00000100:00100000:1.0:1789121146.049633:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121146.052753:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947556864 00000100:00100000:0.0:1789121146.052767:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947556864 00000100:00100000:0.0:1789121146.052868:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00100000:0.0:1789121146.052881:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+6:15195:x1876028947556864:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789121146.052915:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121146.052936:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55600/0xb74d2367a83109e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7edcf expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121146.052965:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55600/0xb74d2367a83109e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edcf expref: 7 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121146.052976:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55600/0xb74d2367a83109e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7edcf expref: 7 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121146.052987:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55600, rc 0) 00000100:00100000:0.0:1789121146.053057:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+7:15195:x1876028947556864:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 179us (3432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121146.053064:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 117 00000100:00100000:0.0:1789121146.063982:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121146.064063:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947556992 00000100:00100000:3.0:1789121146.064080:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947556992 00000100:00100000:3.0:1789121146.064168:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 118 00000100:00100000:3.0:1789121146.064181:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+7:15195:x1876028947556992:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789121146.064415:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+8:15195:x1876028947556992:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 236us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.064425:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 118 00000100:00100000:2.0:1789121146.072349:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121146.073785:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947557120 00000100:00100000:0.0:1789121146.073801:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947557120 00000100:00100000:0.0:1789121146.073940:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 119 00000100:00100000:0.0:1789121146.073952:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+8:15195:x1876028947557120:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789121146.074122:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+8:15195:x1876028947557120:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 172us (1797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121146.074131:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 119 00000100:00100000:1.0:1789121146.078420:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121146.078539:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947557248 00000100:00100000:2.0:1789121146.078553:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947557248 00000100:00100000:2.0:1789121146.078634:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:2.0:1789121146.078646:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468c1d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+8:15213:x1876028947557248:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789121146.078914:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468c1d13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+8:15213:x1876028947557248:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 269us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121146.078924:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 120 00000100:00100000:1.0:1789121146.114360:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121146.114491:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947557376 00000100:00100000:3.0:1789121146.114503:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947557376 00000100:00100000:3.0:1789121146.114574:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 121 00000100:00100000:3.0:1789121146.114586:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+8:15213:x1876028947557376:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789121146.114891:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+8:15213:x1876028947557376:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 305us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.114912:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 121 00000100:00100000:0.0:1789121146.137858:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121146.137962:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947557504 00000100:00100000:2.0:1789121146.137979:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947557504 00000100:00100000:2.0:1789121146.138074:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 122 00000100:00100000:2.0:1789121146.138087:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+8:15213:x1876028947557504:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789121146.139016:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+8:15213:x1876028947557504:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 923us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121146.139028:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 122 00000100:00100000:2.0:1789121146.142339:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121146.145374:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947557632 00000100:00100000:0.0:1789121146.145395:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947557632 00000100:00100000:0.0:1789121146.145562:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 123 00000100:00100000:0.0:1789121146.145575:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+8:15195:x1876028947557632:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789121146.145616:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121146.145644:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55000/0xb74d2367a83109ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ee00 expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121146.145698:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55000/0xb74d2367a83109ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee00 expref: 9 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121146.145713:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55000/0xb74d2367a83109ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee00 expref: 9 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121146.145724:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55000, rc 0) 00000100:00100000:0.0:1789121146.145842:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+9:15195:x1876028947557632:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 269us (3532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121146.145850:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 123 00000100:00100000:1.0:1789121146.151492:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121146.154971:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947557760 00000100:00100000:0.0:1789121146.154994:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947557760 00000100:00100000:1.0:1789121146.155520:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:1.0:1789121146.155536:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+9:15195:x1876028947557760:12345-192.168.202.32@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789121146.155594:0:17847:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789121146.155616:0:17847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789121146.155621:0:17847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789121146.155624:0:17847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789121146.155627:0:17847:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789121146.155630:0:17847:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1789121146.158480:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+9:15195:x1876028947557760:12345-192.168.202.32@tcp:256:mount.lustre.0 Request processed in 2925us (6981us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.158498:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 124 00000100:00100000:3.0:1789121146.162375:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121146.162805:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947557888 00000100:00100000:0.0:1789121146.162858:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947557888 00000100:00100000:1.0:1789121146.162994:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:1.0:1789121146.163014:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+9:15195:x1876028947557888:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789121146.163041:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121146.163068:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a3800/0xb74d2367a83109f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ee07 expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121146.163108:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a3800/0xb74d2367a83109f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee07 expref: 10 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121146.163122:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a3800/0xb74d2367a83109f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee07 expref: 10 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121146.163134:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3800, rc 0) 00000100:00100000:1.0:1789121146.163382:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+10:15195:x1876028947557888:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 375us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121146.163391:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 125 00000100:00100000:1.0:1789121146.166057:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121146.166155:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947558016 00000100:00100000:3.0:1789121146.166167:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947558016 00000100:00100000:3.0:1789121146.166417:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 126 00000100:00100000:3.0:1789121146.166430:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+10:15195:x1876028947558016:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789121146.166895:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+10:15195:x1876028947558016:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 466us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.166905:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 126 00000100:00100000:1.0:1789121146.168969:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121146.169072:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947558144 00000100:00100000:3.0:1789121146.169084:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947558144 00000100:00100000:3.0:1789121146.169159:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 127 00000100:00100000:3.0:1789121146.169170:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946885ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+10:15195:x1876028947558144:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789121146.169384:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946885ad2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+10:15195:x1876028947558144:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 214us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.169394:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 127 00000100:00100000:2.0:1789121146.177225:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121146.177541:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947558272 00000100:00100000:3.0:1789121146.177553:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947558272 00000100:00100000:3.0:1789121146.177630:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 128 00000100:00100000:3.0:1789121146.177642:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+10:15219:x1876028947558272:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789121146.178011:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+10:15219:x1876028947558272:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 369us (800us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.178027:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 128 00000100:00100000:1.0:1789121146.187922:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121146.188408:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947558400 00000100:00100000:2.0:1789121146.188422:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947558400 00000100:00100000:2.0:1789121146.188512:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:2.0:1789121146.188525:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+10:15219:x1876028947558400:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789121146.188911:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+10:15219:x1876028947558400:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 388us (1003us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121146.188929:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 129 00000100:00100000:0.0:1789121146.197233:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121146.197351:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121146.197663:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947558528 00000100:00100000:3.0:1789121146.197685:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947558528 00000100:00100000:3.0:1789121146.197739:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947558784 00000100:00100000:3.0:1789121146.197743:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947558784 00000100:00100000:3.0:1789121146.197774:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789121146.197785:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1876028947558528:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789121146.197851:0:19756:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 7f977f21-a57c-43c4-b0be-1d901bfa40b7@192.168.202.32@tcp t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:3.0:1789121146.197917:0:19756:0:(genops.c:1385:class_connect()) connect: client 7f977f21-a57c-43c4-b0be-1d901bfa40b7, cookie 0xb74d2367a83109fb 00000004:00100000:3.0:1789121146.197949:0:19756:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789121146.198237:0:19756:0:(import.c:65:import_set_state_nolock()) ffff9468afd4b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121146.198334:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2408:x1876028947558528:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 541us (1108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.198344:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789121146.198366:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:3.0:1789121146.198371:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf705680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2408:x1876028947558784:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789121146.198389:0:19756:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 7f977f21-a57c-43c4-b0be-1d901bfa40b7@192.168.202.32@tcp t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:3.0:1789121146.198423:0:19756:0:(genops.c:1385:class_connect()) connect: client 7f977f21-a57c-43c4-b0be-1d901bfa40b7, cookie 0xb74d2367a8310a02 00000004:00100000:3.0:1789121146.198440:0:19756:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789121146.198650:0:19756:0:(import.c:65:import_set_state_nolock()) ffff9468c0738800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121146.198676:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf705680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2408:x1876028947558784:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 303us (1325us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.198683:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:0.0:1789121146.202938:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121146.202980:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121146.203231:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947558912 00000100:00100000:3.0:1789121146.203242:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947558912 00000100:00100000:1.0:1789121146.203396:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947558656 00000100:00100000:1.0:1789121146.203401:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947558656 00000100:00100000:3.0:1789121146.203493:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:3.0:1789121146.203505:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:0:x1876028947558912:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789121146.203556:0:19756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789121146.203692:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:0:x1876028947558912:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 189us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.203701:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:3.0:1789121146.203998:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121146.204136:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947559040 00000100:00100000:0.0:1789121146.204141:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947559040 00000100:00100000:0.0:1789121146.204184:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:0.0:1789121146.204191:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:15195:x1876028947559040:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789121146.204216:0:17856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789121146.204273:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7cf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:15195:x1876028947559040:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 82us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121146.204290:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00080000:2.0:1789121146.205224:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789121146.205233:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789121146.205429:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:1.0:1789121146.205457:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:0:x1876028947558656:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789121146.205496:0:17855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789121146.205870:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:0:x1876028947558656:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 114us (2583us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121146.205878:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:0.0:1789121146.208610:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121146.208733:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947559168 00000100:00100000:2.0:1789121146.208745:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947559168 00000100:00100000:2.0:1789121146.208863:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:2.0:1789121146.208877:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15195:x1876028947559168:12345-192.168.202.32@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789121146.208986:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15195:x1876028947559168:12345-192.168.202.32@tcp:40:mount.lustre.0 Request processed in 113us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121146.208995:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:1.0:1789121146.213948:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121146.213990:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121146.214058:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121146.214214:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947559296 00000100:00100000:3.0:1789121146.214227:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947559296 00000100:00100000:3.0:1789121146.214289:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947559424 00000100:00100000:3.0:1789121146.214292:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947559424 00000100:00100000:3.0:1789121146.214312:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:3.0:1789121146.214322:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2408:x1876028947559296:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789121146.214376:0:19367:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 7f977f21-a57c-43c4-b0be-1d901bfa40b7@192.168.202.32@tcp t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:3.0:1789121146.214418:0:19367:0:(genops.c:1385:class_connect()) connect: client 7f977f21-a57c-43c4-b0be-1d901bfa40b7, cookie 0xb74d2367a8310a09 00002000:00100000:3.0:1789121146.214433:0:19367:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7f977f21-a57c-43c4-b0be-1d901bfa40b7/ffff9468c073f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789121146.214457:0:19367:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789121146.214859:0:19367:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789121146.214902:0:19367:0:(import.c:65:import_set_state_nolock()) ffff9468c073c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789121146.214987:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2e580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2408:x1876028947559296:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 664us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.214996:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:3.0:1789121146.215022:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789121146.215027:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2408:x1876028947559424:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789121146.215048:0:19367:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 7f977f21-a57c-43c4-b0be-1d901bfa40b7@192.168.202.32@tcp t0 exp 0000000000000000 cur 596 last 0 00000020:00000080:3.0:1789121146.215076:0:19367:0:(genops.c:1385:class_connect()) connect: client 7f977f21-a57c-43c4-b0be-1d901bfa40b7, cookie 0xb74d2367a8310a10 00002000:00100000:3.0:1789121146.215082:0:19367:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7f977f21-a57c-43c4-b0be-1d901bfa40b7/ffff9468c073a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789121146.215271:0:19367:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789121146.215441:0:19367:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789121146.215462:0:19367:0:(import.c:65:import_set_state_nolock()) ffff9468c073e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789121146.215656:0:17866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947559552 00000100:00100000:0.0:1789121146.215663:0:17866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947559552 00000100:00100000:0.0:1789121146.215735:0:17866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:0.0:1789121146.215744:0:17866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15195:x1876028947559552:12345-192.168.202.32@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789121146.215794:0:17866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15195:x1876028947559552:12345-192.168.202.32@tcp:900:mount.lustre.0 Request processed in 51us (1861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121146.215801:0:17866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:3.0:1789121146.216593:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2408:x1876028947559424:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 1558us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121146.216605:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:1.0:1789121146.222776:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121146.224977:0:17857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947559680 00000100:00100000:0.0:1789121146.225002:0:17857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947559680 00000100:00100000:0.0:1789121146.225223:0:17857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:0.0:1789121146.225249:0:17857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15195:x1876028947559680:12345-192.168.202.32@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789121146.228342:0:17857:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 2938us 00000004:00200000:1.0:1789121146.251840:0:17857:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789121146.252081:0:17857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15195:x1876028947559680:12345-192.168.202.32@tcp:33:mount.lustre.0 Request processed in 26837us (29314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121146.252117:0:17857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00010000:00010000:2.0:1789121146.326733:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121146.429508:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121146.429595:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947559808 00000100:00100000:2.0:1789121146.429610:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947559808 00000100:00100000:2.0:1789121146.429692:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:2.0:1789121146.429705:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15244:x1876028947559808:12345-192.168.202.32@tcp:101:mkdir.0 00010000:00010000:2.0:1789121146.429733:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121146.429769:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990a00/0xb74d2367a8310a17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ee38 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121146.429931:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310a1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121146.429949:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121146.429965:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121146.430051:0:19755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789121146.430056:0:19755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121146.430217:0:19755:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310a1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121146.430254:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990a00/0xb74d2367a8310a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee38 expref: 8 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121146.430277:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310a1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee38 expref: 7 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121146.430286:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946888a7f600) 00010000:00010000:2.0:1789121146.430289:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789121146.430294:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991e00, rc 0) 00000100:00100000:2.0:1789121146.430377:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:15244:x1876028947559808:12345-192.168.202.32@tcp:101:mkdir.0 Request processed in 674us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121146.430385:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00010000:00010000:2.0:1789121147.346143:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121147.794406:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9467848921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970719616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789121147.794413:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970720000:0@lo:400:kworker.0 00000100:00100000:3.0:1789121147.794499:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970719744:0@lo:400:kworker.0 00000100:00100000:2.0:1789121147.794522:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970719872:0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.794899:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121147.795140:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970720512:0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.795172:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121147.795190:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970721024:0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.795309:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121147.795382:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970720000 00000100:00100000:0.0:1789121147.795392:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970720000 00000100:00100000:0.0:1789121147.795464:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970720512 00000100:00100000:0.0:1789121147.795467:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970720512 00000100:00100000:0.0:1789121147.795491:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789121147.795520:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970720000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.795582:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b252c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970720000:12345-0@lo:400:kworker.0 Request processed in 63us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121147.795591:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789121147.795609:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789121147.795615:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970720512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.795642:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b243c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970720512:12345-0@lo:400:kworker.0 Request processed in 27us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121147.795648:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789121147.795666:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970721024 00000100:00100000:0.0:1789121147.795684:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970721024 00000100:00100000:0.0:1789121147.795715:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789121147.795723:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970721024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.795783:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1876028970721024:12345-0@lo:400:kworker.0 Request processed in 59us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121147.795791:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789121147.795883:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970720000:0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.795895:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970720512:0@lo:400:kworker.0 00010000:00080000:0.0:1789121147.795908:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468b99d0b40 x1876028970721024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789121147.795919:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3645:1876028970721024:0@lo:400:kworker.0 00000100:00080000:0.0:1789121147.795973:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789121147.795979:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789121147.798017:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121147.798096:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970720128:0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.798303:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970719616 00000100:00100000:0.0:1789121147.798321:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970719616 00000100:00100000:0.0:1789121147.798426:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789121147.798438:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876028970719616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789121147.798476:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121147.798533:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3646:x1876028970719616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121147.798540:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1789121147.798565:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789121147.798682:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121147.798712:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970720640:0@lo:400:kworker.0 00000100:00100000:1.0:1789121147.798738:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121147.799020:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970721152:0@lo:400:kworker.0 00000100:00100000:1.0:1789121147.799050:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121147.799109:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9467848921c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970719616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789121147.799223:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970721152 00000100:00100000:1.0:1789121147.799229:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970721152 00000100:00100000:1.0:1789121147.799275:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789121147.799295:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970721152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121147.799353:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1876028970721152:12345-0@lo:400:kworker.0 Request processed in 61us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121147.799360:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789121147.799385:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970720128 00000100:00100000:1.0:1789121147.799389:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970720128 00000100:00100000:1.0:1789121147.799414:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970720640 00000100:00100000:1.0:1789121147.799417:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970720640 00000100:00100000:1.0:1789121147.799441:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789121147.799447:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876028970720128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121147.799480:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3646:x1876028970720128:12345-0@lo:400:kworker.0 Request processed in 33us (798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121147.799485:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789121147.799497:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789121147.799503:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970720640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121147.799530:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970720640:12345-0@lo:400:kworker.0 Request processed in 28us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121147.799535:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789121147.799555:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789121147.799558:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789121147.799577:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf704f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970720128:0@lo:400:kworker.0 00000100:00100000:1.0:1789121147.799587:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970720640:0@lo:400:kworker.0 00000100:00100000:1.0:1789121147.799596:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3646:1876028970721152:0@lo:400:kworker.0 00000100:00100000:3.0:1789121147.799926:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121147.799969:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970720256:0@lo:400:kworker.0 00000100:00100000:3.0:1789121147.799999:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121147.800019:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970720768:0@lo:400:kworker.0 00000100:00100000:3.0:1789121147.800040:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121147.800055:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970721280:0@lo:400:kworker.0 00000100:00100000:3.0:1789121147.800084:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121147.800241:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970720256 00000100:00100000:0.0:1789121147.800247:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970720256 00000100:00100000:0.0:1789121147.800287:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970720768 00000100:00100000:0.0:1789121147.800290:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970720768 00000100:00100000:0.0:1789121147.800321:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970721280 00000100:00100000:0.0:1789121147.800323:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970721280 00000100:00100000:0.0:1789121147.800349:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789121147.800355:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970720256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.800402:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970720256:12345-0@lo:400:kworker.0 Request processed in 46us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121147.800408:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789121147.800421:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789121147.800428:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970720768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.800454:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970720768:12345-0@lo:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121147.800460:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789121147.800470:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789121147.800488:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970721280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.800517:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970721280:12345-0@lo:400:kworker.0 Request processed in 31us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121147.800540:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789121147.801226:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970719744 00000100:00100000:1.0:1789121147.801236:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970719744 00000100:00100000:1.0:1789121147.801302:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789121147.801332:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970719744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121147.801393:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970719744:12345-0@lo:400:kworker.0 Request processed in 62us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121147.801401:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00080000:1.0:1789121147.801442:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121147.802449:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970719744:0@lo:400:kworker.0 00000100:00100000:3.0:1789121147.802475:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970720256:0@lo:400:kworker.0 00000100:00100000:3.0:1789121147.802490:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970720768:0@lo:400:kworker.0 00010000:00080000:3.0:1789121147.802512:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783b24780 x1876028970721280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121147.802525:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970721280:0@lo:400:kworker.0 00000100:00100000:2.0:1789121147.803614:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121147.803720:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970720384:0@lo:400:kworker.0 00000100:00100000:2.0:1789121147.803767:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121147.804068:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946889570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970720896:0@lo:400:kworker.0 00000100:00100000:2.0:1789121147.804102:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121147.804141:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970721408:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789121147.804171:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121147.804252:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970721408 00000100:00100000:2.0:1789121147.804262:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970721408 00000100:00100000:2.0:1789121147.804346:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789121147.804358:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970721408:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789121147.804393:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789121147.804449:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970721408:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121147.804460:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789121147.804525:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970721408:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789121147.804910:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970720896 00000100:00100000:1.0:1789121147.804915:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970720896 00000100:00100000:1.0:1789121147.804975:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789121147.804984:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970720896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121147.805031:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1876028970720896:12345-0@lo:400:kworker.0 Request processed in 49us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121147.805038:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1789121147.807512:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789121147.807653:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946889570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3644:1876028970720896:0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.808040:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970719872 00000100:00100000:0.0:1789121147.808058:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970719872 00000100:00100000:0.0:1789121147.808170:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970720384 00000100:00100000:0.0:1789121147.808180:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970720384 00000100:00100000:0.0:1789121147.808202:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789121147.808212:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970719872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.808391:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848921c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970719872:12345-0@lo:400:kworker.0 Request processed in 174us (4778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121147.808400:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789121147.808436:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789121147.808444:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970720384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121147.808478:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970720384:12345-0@lo:400:kworker.0 Request processed in 35us (4710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121147.808484:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789121147.808973:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970719872:0@lo:400:kworker.0 00000100:00100000:2.0:1789121147.808997:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970720384:0@lo:400:kworker.0 00010000:00010000:2.0:1789121148.371677:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121148.491700:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121148.491806:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947559936 00000100:00100000:0.0:1789121148.491863:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947559936 00000100:00100000:0.0:1789121148.491948:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:0.0:1789121148.491960:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:15296:x1876028947559936:12345-192.168.202.32@tcp:41:lfs.0 00000004:00000024:0.0:1789121148.492009:0:19755:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00080000:2.0:1789121148.492220:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789121148.492316:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:15296:x1876028947559936:12345-192.168.202.32@tcp:41:lfs.0 Request processed in 346us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121148.492327:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:0.0:1789121148.498379:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121148.500320:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947560064 00000100:00100000:3.0:1789121148.500339:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947560064 00000100:00100000:3.0:1789121148.500462:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:3.0:1789121148.500476:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15296:x1876028947560064:12345-192.168.202.32@tcp:41:lfs.0 00000004:00000024:3.0:1789121148.500533:0:17854:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789121148.500672:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b261c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15296:x1876028947560064:12345-192.168.202.32@tcp:41:lfs.0 Request processed in 198us (2308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121148.500681:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00080000:2.0:1789121148.501354:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121148.505905:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121148.506164:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947560192 00000100:00100000:2.0:1789121148.506178:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947560192 00000100:00080000:1.0:1789121148.506391:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121148.506484:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:2.0:1789121148.506498:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15296:x1876028947560192:12345-192.168.202.32@tcp:13:lfs.0 00002000:00000024:2.0:1789121148.506546:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789121148.506670:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7c780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15296:x1876028947560192:12345-192.168.202.32@tcp:13:lfs.0 Request processed in 175us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121148.506679:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:0.0:1789121148.509924:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121148.510163:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947560320 00000100:00100000:2.0:1789121148.510176:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947560320 00000100:00080000:1.0:1789121148.510342:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789121148.510434:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:2.0:1789121148.510447:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15296:x1876028947560320:12345-192.168.202.32@tcp:13:lfs.0 00002000:00000024:2.0:1789121148.510597:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923509248 avail 3691986944 00000100:00100000:2.0:1789121148.510716:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15296:x1876028947560320:12345-192.168.202.32@tcp:13:lfs.0 Request processed in 270us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121148.510725:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 12 00000100:00100000:3.0:1789121148.732526:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121148.732704:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947560448 00000100:00100000:1.0:1789121148.732718:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947560448 00000100:00100000:1.0:1789121148.732799:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 131 00000100:00100000:1.0:1789121148.732811:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+10:15330:x1876028947560448:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789121148.732879:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121148.732902:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a2e00/0xb74d2367a8310a25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ee3f expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121148.732939:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a2e00/0xb74d2367a8310a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee3f expref: 11 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121148.732950:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a2e00/0xb74d2367a8310a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee3f expref: 11 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121148.732985:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2e00, rc 0) 00000100:00100000:1.0:1789121148.733054:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+11:15330:x1876028947560448:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 246us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121148.733062:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 131 00000100:00100000:3.0:1789121148.737147:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121148.740911:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947560576 00000100:00100000:0.0:1789121148.740957:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947560576 00000100:00100000:0.0:1789121148.741050:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 132 00000100:00100000:0.0:1789121148.741062:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+11:15330:x1876028947560576:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789121148.741334:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e98450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+11:15330:x1876028947560576:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 271us (4201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121148.741343:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 132 00000100:00100000:0.0:1789121148.768773:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121148.770167:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947560704 00000100:00100000:3.0:1789121148.770310:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947560704 00000100:00100000:3.0:1789121148.770473:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 133 00000100:00100000:3.0:1789121148.770488:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+11:15330:x1876028947560704:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789121148.770709:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e99050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+11:15330:x1876028947560704:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 225us (1952us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121148.770719:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 133 00000100:00100000:3.0:1789121148.781299:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121148.783849:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947560832 00000100:00100000:1.0:1789121148.783878:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947560832 00000100:00100000:1.0:1789121148.783970:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:1.0:1789121148.783981:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+11:15335:x1876028947560832:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789121148.784436:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e98850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+11:15335:x1876028947560832:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 454us (3150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121148.784447:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 134 00000100:00100000:2.0:1789121148.809341:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121148.809973:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947560960 00000100:00100000:3.0:1789121148.809987:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947560960 00000100:00100000:2.0:1789121148.810400:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 135 00000100:00100000:2.0:1789121148.810414:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+11:15335:x1876028947560960:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789121148.810702:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+11:15335:x1876028947560960:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 290us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121148.810722:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 135 00000100:00100000:2.0:1789121148.817393:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121148.822148:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947561088 00000100:00100000:1.0:1789121148.822169:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947561088 00000100:00100000:1.0:1789121148.822279:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 136 00000100:00100000:1.0:1789121148.822297:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+11:15335:x1876028947561088:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789121148.822529:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783e9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+11:15335:x1876028947561088:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 235us (5152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121148.822539:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 136 00000001:00100000:0.0:1789121148.822888:0:20185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7f977f21-a57c-43c4-b0be-1d901bfa40b7 00000001:00080000:0.0:1789121148.822903:0:20185:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:3.0:1789121148.825061:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121148.825179:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947561216 00000100:00100000:2.0:1789121148.825191:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947561216 00000100:00100000:2.0:1789121148.825262:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 137 00000100:00100000:2.0:1789121148.825274:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+11:15330:x1876028947561216:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789121148.825298:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121148.825333:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa991200/0xb74d2367a8310a2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ee70 expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121148.825368:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa991200/0xb74d2367a8310a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee70 expref: 12 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121148.825380:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa991200/0xb74d2367a8310a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee70 expref: 12 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121148.825414:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991200, rc 0) 00000100:00100000:2.0:1789121148.825498:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+12:15330:x1876028947561216:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 226us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121148.825506:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 137 00000100:00100000:3.0:1789121148.830916:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121148.831035:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947561344 00000100:00100000:1.0:1789121148.831049:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947561344 00000100:00100000:1.0:1789121148.831131:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 138 00000100:00100000:1.0:1789121148.831143:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+12:15330:x1876028947561344:12345-192.168.202.32@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789121148.831180:0:17848:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789121148.831215:0:17848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789121148.831227:0:17848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789121148.831230:0:17848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789121148.831233:0:17848:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1789121148.831236:0:17848:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1789121148.833108:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+12:15330:x1876028947561344:12345-192.168.202.32@tcp:256:mount.lustre.0 Request processed in 1949us (2190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121148.833125:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 138 00000100:00100000:3.0:1789121148.837653:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121148.837877:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947561472 00000100:00100000:1.0:1789121148.837891:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947561472 00000100:00100000:1.0:1789121148.838020:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 139 00000100:00100000:1.0:1789121148.838033:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+12:15330:x1876028947561472:12345-192.168.202.32@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789121148.838059:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121148.838084:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a2400/0xb74d2367a8310a33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ee77 expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121148.838140:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a2400/0xb74d2367a8310a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee77 expref: 13 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121148.838155:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a2400/0xb74d2367a8310a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee77 expref: 13 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121148.838166:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2400, rc 0) 00000100:00100000:1.0:1789121148.838247:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+13:15330:x1876028947561472:12345-192.168.202.32@tcp:101:mount.lustre.0 Request processed in 216us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121148.838255:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 139 00000100:00100000:3.0:1789121148.846645:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121148.847075:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947561600 00000100:00100000:1.0:1789121148.847089:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947561600 00000100:00100000:1.0:1789121148.847166:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 140 00000100:00100000:1.0:1789121148.847178:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+13:15330:x1876028947561600:12345-192.168.202.32@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789121148.847430:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+13:15330:x1876028947561600:12345-192.168.202.32@tcp:501:mount.lustre.0 Request processed in 253us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121148.847439:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 140 00000100:00100000:0.0:1789121148.853332:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121148.853764:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947561728 00000100:00100000:1.0:1789121148.853778:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947561728 00000100:00100000:1.0:1789121148.857860:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 141 00000100:00100000:1.0:1789121148.857895:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+13:15330:x1876028947561728:12345-192.168.202.32@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789121148.858145:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5ab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+13:15330:x1876028947561728:12345-192.168.202.32@tcp:503:mount.lustre.0 Request processed in 267us (4826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121148.858155:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 141 00000100:00100000:3.0:1789121148.862045:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121148.864438:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947561856 00000100:00100000:2.0:1789121148.864460:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947561856 00000100:00100000:2.0:1789121148.864572:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 142 00000100:00100000:2.0:1789121148.864586:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+13:15339:x1876028947561856:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789121148.864816:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+13:15339:x1876028947561856:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 232us (2786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121148.864852:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 142 00000100:00100000:3.0:1789121148.868920:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121148.869035:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947561984 00000100:00100000:1.0:1789121148.869047:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947561984 00000100:00100000:1.0:1789121148.869122:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 143 00000100:00100000:1.0:1789121148.869133:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+13:15339:x1876028947561984:12345-192.168.202.32@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789121148.869625:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+13:15339:x1876028947561984:12345-192.168.202.32@tcp:502:llog_process_th.0 Request processed in 491us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121148.869635:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 143 00000100:00100000:0.0:1789121148.874076:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121148.874115:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121148.874147:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121148.874270:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947562624 00000100:00100000:3.0:1789121148.874283:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947562624 00000100:00100000:3.0:1789121148.874407:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:3.0:1789121148.874418:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2409:x1876028947562624:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121148.874506:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2409:x1876028947562624:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 90us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121148.874514:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:0.0:1789121148.874707:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121148.874741:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121148.874761:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947562752 00000100:00100000:0.0:1789121148.874765:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947562752 00000100:00100000:0.0:1789121148.874791:0:20006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:0.0:1789121148.874797:0:20006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2409:x1876028947562752:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121148.874862:0:20006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26d00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2409:x1876028947562752:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 65us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121148.874869:0:20006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:0.0:1789121148.874905:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121148.874999:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947562112 00000100:00100000:2.0:1789121148.875006:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947562112 00000100:00100000:2.0:1789121148.875036:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947562368 00000100:00100000:2.0:1789121148.875038:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947562368 00000100:00100000:2.0:1789121148.875054:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947562496 00000100:00100000:2.0:1789121148.875056:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947562496 00000100:00100000:2.0:1789121148.875066:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947562880 00000100:00100000:2.0:1789121148.875068:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947562880 00000100:00100000:2.0:1789121148.875078:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:2.0:1789121148.875084:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:2409:x1876028947562368:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121148.875129:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:2409:x1876028947562368:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 45us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121148.875136:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:2.0:1789121148.875147:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:2.0:1789121148.875153:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2409:x1876028947562496:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121148.875210:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b270c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2409:x1876028947562496:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 56us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121148.875217:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:2.0:1789121148.875228:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:2.0:1789121148.875233:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2408:x1876028947562112:12345-192.168.202.32@tcp:38:mount.lustre.0 00000100:00100000:0.0:1789121148.875506:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:0.0:1789121148.875512:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2408:x1876028947562880:12345-192.168.202.32@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789121148.875547:0:17856:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0001: connection from 0d1c643e-f8d1-4998-bc1e-8baa38374a62@192.168.202.32@tcp t0 exp 0000000000000000 cur 599 last 0 00000020:00000080:0.0:1789121148.875591:0:17856:0:(genops.c:1385:class_connect()) connect: client 0d1c643e-f8d1-4998-bc1e-8baa38374a62, cookie 0xb74d2367a8310a3a 00000004:00100000:0.0:1789121148.875625:0:17856:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789121148.875748:0:17856:0:(import.c:65:import_set_state_nolock()) ffff9468c0782800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789121148.875781:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2408:x1876028947562880:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 267us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121148.875788:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00010000:00080000:2.0:1789121148.875874:0:19755:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-MDT0000: connection from 0d1c643e-f8d1-4998-bc1e-8baa38374a62@192.168.202.32@tcp t0 exp 0000000000000000 cur 599 last 0 00000020:00000080:2.0:1789121148.875896:0:19755:0:(genops.c:1385:class_connect()) connect: client 0d1c643e-f8d1-4998-bc1e-8baa38374a62, cookie 0xb74d2367a8310a41 00000004:00100000:2.0:1789121148.875910:0:19755:0:(mdt_handler.c:7302:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789121148.875956:0:19755:0:(import.c:65:import_set_state_nolock()) ffff94678297e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121148.875977:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2408:x1876028947562112:12345-192.168.202.32@tcp:38:mount.lustre.0 Request processed in 743us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121148.875984:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:0.0:1789121148.882937:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121148.883133:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947563008 00000100:00100000:1.0:1789121148.883147:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947563008 00000100:00100000:1.0:1789121148.883258:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:1.0:1789121148.883271:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:0:x1876028947563008:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789121148.883332:0:17856:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789121148.883498:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:0:x1876028947563008:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 230us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121148.883528:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00080000:2.0:1789121148.883927:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121148.891193:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121148.892094:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121148.892120:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947563136 00000100:00100000:1.0:1789121148.892133:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947563136 00000100:00100000:1.0:1789121148.892309:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:1.0:1789121148.892325:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:15330:x1876028947563136:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789121148.892384:0:19756:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789121148.893245:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947562240 00000100:00100000:3.0:1789121148.893254:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947562240 00000100:00100000:3.0:1789121148.893308:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:3.0:1789121148.893318:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+7:0:x1876028947562240:12345-192.168.202.32@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789121148.893340:0:17855:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1789121148.893385:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+7:0:x1876028947562240:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 68us (1296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121148.893395:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:1.0:1789121148.894385:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:15330:x1876028947563136:12345-192.168.202.32@tcp:41:mount.lustre.0 Request processed in 2050us (3193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121148.894398:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00080000:2.0:1789121148.894812:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789121148.905785:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121148.911758:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947563264 00000100:00100000:0.0:1789121148.911779:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947563264 00000100:00100000:0.0:1789121148.911900:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:0.0:1789121148.911914:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:15330:x1876028947563264:12345-192.168.202.32@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789121148.912114:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:15330:x1876028947563264:12345-192.168.202.32@tcp:40:mount.lustre.0 Request processed in 202us (6344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121148.912123:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:3.0:1789121148.915900:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121148.915939:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121148.915981:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121148.916145:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947563392 00000100:00100000:2.0:1789121148.916157:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947563392 00000100:00100000:2.0:1789121148.916224:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947563520 00000100:00100000:2.0:1789121148.916227:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947563520 00000100:00100000:2.0:1789121148.916250:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:2.0:1789121148.916260:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2408:x1876028947563392:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789121148.916335:0:19367:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0000: connection from 0d1c643e-f8d1-4998-bc1e-8baa38374a62@192.168.202.32@tcp t0 exp 0000000000000000 cur 599 last 0 00000020:00000080:2.0:1789121148.916377:0:19367:0:(genops.c:1385:class_connect()) connect: client 0d1c643e-f8d1-4998-bc1e-8baa38374a62, cookie 0xb74d2367a8310a48 00002000:00100000:2.0:1789121148.916392:0:19367:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0d1c643e-f8d1-4998-bc1e-8baa38374a62/ffff94678297a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789121148.916407:0:19367:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789121148.916533:0:19367:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789121148.916576:0:19367:0:(import.c:65:import_set_state_nolock()) ffff946782978000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121148.916868:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7e940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2408:x1876028947563392:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 607us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121148.916878:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:2.0:1789121148.916901:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:2.0:1789121148.916906:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2408:x1876028947563520:12345-192.168.202.32@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789121148.916927:0:19367:0:(ldlm_lib.c:1482:target_handle_connect()) lustre-OST0001: connection from 0d1c643e-f8d1-4998-bc1e-8baa38374a62@192.168.202.32@tcp t0 exp 0000000000000000 cur 599 last 0 00000020:00000080:2.0:1789121148.916949:0:19367:0:(genops.c:1385:class_connect()) connect: client 0d1c643e-f8d1-4998-bc1e-8baa38374a62, cookie 0xb74d2367a8310a4f 00002000:00100000:2.0:1789121148.916955:0:19367:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0d1c643e-f8d1-4998-bc1e-8baa38374a62/ffff94678297a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211398b ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789121148.916962:0:19367:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789121148.917018:0:19367:0:(ofd_obd.c:389:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789121148.917037:0:19367:0:(import.c:65:import_set_state_nolock()) ffff94678297c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789121148.917061:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2408:x1876028947563520:12345-192.168.202.32@tcp:8:mount.lustre.0 Request processed in 154us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121148.917068:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:0.0:1789121148.917323:0:17866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947563648 00000100:00100000:0.0:1789121148.917330:0:17866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947563648 00000100:00100000:0.0:1789121148.917379:0:17866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:0.0:1789121148.917388:0:17866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:15330:x1876028947563648:12345-192.168.202.32@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789121148.917430:0:17866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:15330:x1876028947563648:12345-192.168.202.32@tcp:900:mount.lustre.0 Request processed in 44us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121148.917437:0:17866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:1.0:1789121148.925983:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121148.926056:0:17858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947563776 00000100:00100000:0.0:1789121148.926071:0:17858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947563776 00000100:00100000:0.0:1789121148.926140:0:17858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:0.0:1789121148.926153:0:17858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:15330:x1876028947563776:12345-192.168.202.32@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789121148.926316:0:17858:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789121148.926431:0:17858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:15330:x1876028947563776:12345-192.168.202.32@tcp:33:mount.lustre.0 Request processed in 280us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121148.926440:0:17858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:2.0:1789121149.108805:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121149.108949:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947563904 00000100:00100000:3.0:1789121149.108962:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947563904 00000100:00100000:3.0:1789121149.109048:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:3.0:1789121149.109060:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:15364:x1876028947563904:12345-192.168.202.32@tcp:101:mkdir.0 00010000:00010000:3.0:1789121149.109090:0:17856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121149.109142:0:17856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8310a56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eea8 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121149.109244:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121149.109265:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121149.109285:0:17856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789121149.109362:0:17856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789121149.109372:0:17856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789121149.109401:0:17856:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121149.109435:0:17856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1600/0xb74d2367a8310a56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eea8 expref: 8 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121149.109457:0:17856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eea8 expref: 7 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121149.109466:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946888a7f600) 00010000:00010000:3.0:1789121149.109469:0:17856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789121149.109474:0:17856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0400, rc 0) 00000100:00100000:3.0:1789121149.109561:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+7:15364:x1876028947563904:12345-192.168.202.32@tcp:101:mkdir.0 Request processed in 502us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121149.109569:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00010000:00010000:2.0:1789121149.394226:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121149.842481:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970721536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121149.842562:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121149.842638:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970721536 00000100:00100000:0.0:1789121149.842646:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970721536 00000100:00100000:0.0:1789121149.842701:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789121149.842711:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970721536:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789121149.842752:0:17860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1789121149.842813:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b25680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970721536:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121149.842838:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789121149.842888:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b27840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970721536:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121149.843515:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970721664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121149.843560:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121149.845279:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970721792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121149.845354:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121149.845576:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970721920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121149.845638:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121149.845691:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970721920 00000100:00100000:3.0:1789121149.845699:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970721920 00000100:00100000:3.0:1789121149.845747:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789121149.845756:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970721920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789121149.845801:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789121149.845878:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970721920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121149.845885:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789121149.845927:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b26580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970721920:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121149.852226:0:19370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970721664 00000100:00100000:2.0:1789121149.852240:0:19370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970721664 00000100:00080000:2.0:1789121149.852319:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121149.852373:0:19370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970721792 00000100:00100000:2.0:1789121149.852377:0:19370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970721792 00000100:00080000:2.0:1789121149.852391:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121149.852421:0:19370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789121149.852432:0:19370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970721664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789121149.852786:0:19370:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789121149.852922:0:19370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b27840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970721664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 491us (9359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121149.852931:0:19370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789121149.852951:0:19370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789121149.852958:0:19370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970721792:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789121149.852969:0:19370:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1789121149.853004:0:19370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970721792:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (7648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121149.853010:0:19370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789121149.853055:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970721792:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789121149.853160:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970721664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789121150.418983:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789121150.930802:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789121151.442289:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789121151.808503:0:20743:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:0.0:1789121151.897790:0:19362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0d1c643e-f8d1-4998-bc1e-8baa38374a62 00000001:00100000:0.0:1789121151.897804:0:19362:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7f977f21-a57c-43c4-b0be-1d901bfa40b7 00000001:00100000:3.0:1789121151.898729:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0d1c643e-f8d1-4998-bc1e-8baa38374a62 00000001:00100000:3.0:1789121151.898739:0:18590:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 7f977f21-a57c-43c4-b0be-1d901bfa40b7 00000001:00100000:1.0:1789121151.902135:0:17834:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0d1c643e-f8d1-4998-bc1e-8baa38374a62 00000001:00100000:1.0:1789121151.902149:0:17834:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7f977f21-a57c-43c4-b0be-1d901bfa40b7 00010000:00010000:2.0:1789121152.467054:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121152.916729:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970722176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789121152.916850:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121152.916957:0:19370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970722176 00000100:00100000:1.0:1789121152.916968:0:19370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970722176 00000100:00100000:1.0:1789121152.917039:0:19370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789121152.917053:0:19370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970722176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789121152.917096:0:19370:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:1.0:1789121152.917153:0:19370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970722176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121152.917161:0:19370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:1.0:1789121152.917185:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789121152.917216:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:1.0:1789121152.917249:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970722176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789121152.917864:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789121152.917882:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970722048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789121152.917934:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121152.917974:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970722048 00000100:00100000:3.0:1789121152.917979:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970722048 00000100:00100000:3.0:1789121152.918020:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789121152.918028:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970722048:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789121152.918045:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789121152.918082:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970722048:12345-0@lo:13:osp-pre-1-1.0 Request processed in 55us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121152.918089:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1789121152.918114:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789121152.918142:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970722048:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789121152.919600:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970722304:0@lo:400:kworker.0 00000100:00100000:3.0:1789121152.919686:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121152.919733:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970722816:0@lo:400:kworker.0 00000100:00100000:3.0:1789121152.919761:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121152.919784:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970723328:0@lo:400:kworker.0 00000100:00100000:3.0:1789121152.919812:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121152.919872:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970722304 00000100:00100000:3.0:1789121152.919881:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970722304 00000100:00100000:3.0:1789121152.919938:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789121152.919948:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970722304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121152.920004:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5ab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970722304:12345-0@lo:400:kworker.0 Request processed in 57us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121152.920012:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789121152.920050:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970722816 00000100:00100000:3.0:1789121152.920053:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970722816 00000100:00100000:3.0:1789121152.920076:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789121152.920082:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf75d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970722816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121152.920118:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf75d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970722816:12345-0@lo:400:kworker.0 Request processed in 36us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121152.920124:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789121152.920142:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970723328 00000100:00100000:3.0:1789121152.920145:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970723328 00000100:00100000:1.0:1789121152.920360:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970722688:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.920528:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121152.920563:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970723200:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.920597:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121152.920632:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970722688 00000100:00100000:1.0:1789121152.920636:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970722688 00000100:00100000:1.0:1789121152.920662:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970723200 00000100:00100000:1.0:1789121152.920664:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970723200 00000100:00100000:1.0:1789121152.920684:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789121152.920690:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970722688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.920724:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914ded00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1876028970722688:12345-0@lo:400:kworker.0 Request processed in 34us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121152.920730:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789121152.920741:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789121152.920746:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970723200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.920769:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dcf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970723200:12345-0@lo:400:kworker.0 Request processed in 23us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121152.920776:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789121152.920840:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3646:1876028970722688:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.920851:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970723200:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.920900:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970722560:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.920931:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121152.920955:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970723072:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.920975:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121152.921015:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970723584:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.921046:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121152.921066:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789121152.921074:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970722432:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.921100:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121152.921121:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970722944:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.921143:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121152.921160:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970723456:0@lo:400:kworker.0 00000100:00100000:3.0:1789121152.922335:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970723072 00000100:00100000:3.0:1789121152.922348:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970723072 00000100:00100000:3.0:1789121152.922382:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970723584 00000100:00100000:3.0:1789121152.922385:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970723584 00000100:00100000:3.0:1789121152.922647:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789121152.922669:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970723328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121152.922775:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b05e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1876028970723328:12345-0@lo:400:kworker.0 Request processed in 109us (2961us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121152.922782:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789121152.922804:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789121152.922811:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970723072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121152.922915:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789121152.922926:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970723584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121152.922973:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970723584:12345-0@lo:400:kworker.0 Request processed in 51us (1926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121152.922980:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789121152.923008:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970722560 00000100:00100000:0.0:1789121152.923013:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970722560 00000100:00100000:0.0:1789121152.923052:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970722944 00000100:00100000:0.0:1789121152.923055:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970722944 00000100:00100000:0.0:1789121152.923079:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789121152.923086:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970722560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121152.923117:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970722560:12345-0@lo:400:kworker.0 Request processed in 33us (2186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121152.923122:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789121152.923134:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789121152.923138:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970722944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121152.923162:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970722944:12345-0@lo:400:kworker.0 Request processed in 24us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121152.923166:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789121152.923343:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121152.923589:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970723072:12345-0@lo:400:kworker.0 Request processed in 778us (2611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121152.923597:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789121152.923610:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970723456 00000100:00100000:3.0:1789121152.923613:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970723456 00000100:00100000:3.0:1789121152.923653:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789121152.923660:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970723456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121152.923689:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dfc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970723456:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121152.923695:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789121152.923723:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970722432 00000100:00100000:3.0:1789121152.923727:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970722432 00000100:00100000:3.0:1789121152.923754:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789121152.923760:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970722432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789121152.923796:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dd2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970722432:12345-0@lo:400:kworker.0 Request processed in 36us (2695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121152.923802:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1789121152.923905:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789121152.923912:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789121152.923914:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121152.923957:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970722304:0@lo:400:kworker.0 00000100:00100000:3.0:1789121152.923986:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970722816:0@lo:400:kworker.0 00010000:00080000:3.0:1789121152.924004:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468914de1c0 x1876028970723328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789121152.924016:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3647:1876028970723328:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.924085:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970722560:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.924106:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914de580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970723072:0@lo:400:kworker.0 00010000:00080000:1.0:1789121152.924119:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468914dde00 x1876028970723584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121152.924128:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970723584:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.924149:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970722432:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.924163:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970722944:0@lo:400:kworker.0 00000100:00100000:1.0:1789121152.924570:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914df0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970723456:0@lo:400:kworker.0 00010000:00010000:0.0:1789121153.491143:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121154.001101:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121154.001145:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121154.001172:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121154.001201:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121154.001212:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947564544 00000100:00100000:3.0:1789121154.001220:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121154.001230:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947564544 00000100:00100000:3.0:1789121154.001240:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121154.001270:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121154.001287:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121154.001307:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121154.001318:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947565056 00000100:00100000:0.0:1789121154.001321:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947565056 00000100:00100000:3.0:1789121154.001327:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947564032 00000100:00100000:3.0:1789121154.001329:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947564032 00000100:00100000:0.0:1789121154.001337:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947564416 00000100:00100000:0.0:1789121154.001339:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947564416 00000100:00100000:0.0:1789121154.001351:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947564928 00000100:00100000:0.0:1789121154.001353:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947564928 00000100:00100000:3.0:1789121154.001362:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:0.0:1789121154.001366:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:3.0:1789121154.001373:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+13:2411:x1876028947564032:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121154.001373:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947564544:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121154.001473:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947564544:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 101us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121154.001483:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:3.0:1789121154.001499:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+13:2411:x1876028947564032:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 128us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121154.001502:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:3.0:1789121154.001507:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 145 00000100:00100000:0.0:1789121154.001508:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2411:x1876028947565056:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121154.001531:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2411:x1876028947565056:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 23us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121154.001537:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:3.0:1789121154.001542:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947564288 00000100:00100000:3.0:1789121154.001545:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947564288 00000100:00100000:0.0:1789121154.001547:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:0.0:1789121154.001552:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947564416:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121154.001573:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947564800 00000100:00100000:3.0:1789121154.001576:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947564800 00000100:00100000:0.0:1789121154.001577:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b052c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947564416:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121154.001584:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:3.0:1789121154.001590:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947564160 00000100:00100000:3.0:1789121154.001593:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947564160 00000100:00100000:0.0:1789121154.001593:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:0.0:1789121154.001599:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2411:x1876028947564928:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121154.001614:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947564672 00000100:00100000:3.0:1789121154.001618:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947564672 00000100:00100000:0.0:1789121154.001620:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b05680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2411:x1876028947564928:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 22us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121154.001626:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:3.0:1789121154.001632:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:3.0:1789121154.001638:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947564288:12345-192.168.202.32@tcp:400:kworker.0 00000100:00080000:0.0:1789121154.001646:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789121154.001651:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789121154.001654:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789121154.001656:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789121154.001666:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b043c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947564288:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121154.001670:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:3.0:1789121154.001674:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:0.0:1789121154.001677:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2411:x1876028947564800:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121154.001684:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:3.0:1789121154.001690:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2411:x1876028947564160:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121154.001709:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b06940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2411:x1876028947564160:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 18us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121154.001709:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2411:x1876028947564800:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121154.001715:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:0.0:1789121154.003580:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:0.0:1789121154.003630:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:0.0:1789121154.003646:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2411:x1876028947564672:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121154.004231:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b06d00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2411:x1876028947564672:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 586us (2936us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121154.004241:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 49 00010000:00010000:3.0:1789121154.516911:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121154.964408:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970723712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789121154.964508:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121154.964956:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789121154.964966:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970723840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121154.965005:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121154.965072:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970723840 00000100:00100000:1.0:1789121154.965082:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970723840 00000100:00100000:1.0:1789121154.965148:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789121154.965160:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970723840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789121154.965207:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1789121154.965269:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d2580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970723840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 110us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121154.965295:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789121154.965456:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970723712 00000100:00100000:3.0:1789121154.965461:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970723712 00000100:00100000:3.0:1789121154.965503:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789121154.965511:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970723712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789121154.965536:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789121154.965572:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b26580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970723712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121154.965579:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1789121154.965597:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789121154.965693:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789121154.965704:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970723968:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789121154.965735:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121154.965761:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970723968 00000100:00100000:1.0:1789121154.965764:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970723968 00000100:00100000:1.0:1789121154.965785:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789121154.965792:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970723968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789121154.965812:0:17860:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789121154.965873:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970723968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121154.965880:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789121154.965924:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970723968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121154.966045:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dd680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970723840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121154.966062:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970723712:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789121154.973559:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789121154.973593:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970724096:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789121154.973694:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121154.973755:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970724096 00000100:00100000:3.0:1789121154.973783:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970724096 00000100:00100000:3.0:1789121154.973872:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789121154.973884:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970724096:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789121154.973927:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789121154.973974:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b05a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970724096:12345-0@lo:13:osp-pre-0-1.0 Request processed in 92us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121154.973983:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1789121154.974007:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121154.974049:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970724096:0@lo:13:osp-pre-0-1.0 00000001:00100000:1.0:1789121154.979302:0:20185:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0d1c643e-f8d1-4998-bc1e-8baa38374a62 00010000:00010000:0.0:1789121155.538116:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789121155.698429:0:20891:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb3db97c0 20000000:00000080:3.0:1789121155.698454:0:20891:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff946890865c00 uarg=0000000000000000 20000000:01000000:3.0:1789121155.698514:0:20891:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789121155.698522:0:20891:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789121155.698528:0:20891:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789121155.701399:0:20892:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 19 20000000:00000400:3.0:1789121155.701644:0:20891:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789121155.711139:0:20891:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789121155.720677:0:20891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.720713:0:20891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946783c3a200/0xb74d2367a83106f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a83106f2 expref: 23 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.720722:0:20891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff946899a54800/0xb74d2367a8310707 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310700 expref: 23 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.720730:0:20891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310746 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831073f expref: 23 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.720758:0:20891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a2c00/0xb74d2367a83108a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a831089d expref: 23 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.720768:0:20891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a3800/0xb74d2367a83109f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee07 expref: 12 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.720776:0:20891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9468b99a2400/0xb74d2367a8310a33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee77 expref: 12 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.720785:0:20891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.720871:0:20891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a2400/0xb74d2367a8310a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee77 expref: 12 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.720890:0:20891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468b99a2400/0xb74d2367a8310a33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee77 expref: 12 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121155.720909:0:20891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724224:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789121155.721043:0:20891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a3800/0xb74d2367a83109f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee07 expref: 12 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.721052:0:20891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468b99a3800/0xb74d2367a83109f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee07 expref: 12 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121155.721061:0:20891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf707840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724352:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789121155.721096:0:20891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a2c00/0xb74d2367a83108a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a831089d expref: 23 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.721120:0:20891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468b99a2c00/0xb74d2367a83108a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a831089d expref: 23 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121155.721130:0:20891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7052c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724480:0@lo:104: 00000100:00100000:0.0:1789121155.721181:0:20891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789121155.721225:0:20891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310746 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a831073f expref: 23 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.721232:0:20891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310746 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a831073f expref: 23 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121155.721254:0:20891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf704780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724608:0@lo:104: 00000100:00100000:0.0:1789121155.721276:0:20891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789121155.721300:0:20891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946899a54800/0xb74d2367a8310707 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a8310700 expref: 23 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.721308:0:20891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946899a54800/0xb74d2367a8310707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a8310700 expref: 23 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121155.721316:0:20891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf706940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724736:0@lo:104: 00000100:00100000:0.0:1789121155.721336:0:20891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789121155.721353:0:20891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff946783c3a200/0xb74d2367a83106f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xb74d2367a83106f2 expref: 23 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.721360:0:20891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff946783c3a200/0xb74d2367a83106f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xb74d2367a83106f2 expref: 23 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121155.721369:0:20891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf704000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724864:0@lo:104: 00000100:00100000:0.0:1789121155.721396:0:20891:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121155.721406:0:20891:0:(client.c:2715:ptlrpc_set_wait()) set ffff946890f29e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789121155.721711:0:17838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970724480 00000100:00100000:1.0:1789121155.721722:0:17838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970724480 00000100:00100000:1.0:1789121155.721776:0:17838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970724608 00000100:00100000:1.0:1789121155.721779:0:17838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970724608 00000100:00100000:1.0:1789121155.721792:0:17838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970724736 00000100:00100000:1.0:1789121155.721794:0:17838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970724736 00000100:00100000:1.0:1789121155.721804:0:17838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970724864 00000100:00100000:1.0:1789121155.721806:0:17838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970724864 00000100:00100000:1.0:1789121155.721844:0:17838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789121155.721855:0:17838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf705a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+6:20891:x1876028970724480:12345-0@lo:104: 00010000:00010000:1.0:1789121155.721871:0:17838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.721945:0:17838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789121155.721953:0:17838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf705a40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+6:20891:x1876028970724480:12345-0@lo:104: Request processed in 100us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121155.721961:0:17838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789121155.721981:0:17838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789121155.721987:0:17838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf707c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+5:20891:x1876028970724608:12345-0@lo:104: 00010000:00010000:1.0:1789121155.721995:0:17838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722033:0:17838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789121155.722038:0:17838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf707c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+5:20891:x1876028970724608:12345-0@lo:104: Request processed in 52us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121155.722044:0:17838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789121155.722056:0:17838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789121155.722062:0:17838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+4:20891:x1876028970724736:12345-0@lo:104: 00010000:00010000:1.0:1789121155.722069:0:17838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722095:0:17838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789121155.722100:0:17838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+4:20891:x1876028970724736:12345-0@lo:104: Request processed in 40us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121155.722106:0:17838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789121155.722117:0:17838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789121155.722123:0:17838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:20891:x1876028970724864:12345-0@lo:104: 00010000:00010000:1.0:1789121155.722131:0:17838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722165:0:17838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789121155.722170:0:17838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+3:20891:x1876028970724864:12345-0@lo:104: Request processed in 48us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121155.722176:0:17838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789121155.722199:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789121155.722206:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722214:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121155.722218:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722226:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121155.722233:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121155.722254:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789121155.722294:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722302:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789121155.722325:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722333:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468aa991000/0xb74d2367a831089d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83108a4 expref: -99 pid: 20184 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722357:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789121155.722361:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722367:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3b000 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121155.722370:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722376:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121155.722383:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121155.722389:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789121155.722403:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722408:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789121155.722415:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722421:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783c3b000/0xb74d2367a831073f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310746 expref: -99 pid: 19361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722430:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789121155.722432:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722448:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946783c3b400 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121155.722451:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722457:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121155.722463:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121155.722468:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789121155.722480:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722486:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789121155.722502:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722509:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff946783c3b400/0xb74d2367a8310700 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a8310707 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722518:0:17843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789121155.722521:0:17843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722527:0:17843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3c00 already unused, calling callback (ffffffffc130ac20) 10000000:00010000:1.0:1789121155.722530:0:17843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722549:0:17843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789121155.722556:0:17843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789121155.722561:0:17843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789121155.722573:0:17843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722577:0:17843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789121155.722582:0:17843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722588:0:17843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.132@tcp lock: ffff9468b99a3c00/0xb74d2367a83106f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xb74d2367a83106f9 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.722603:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121155.722604:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789121155.722606:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121155.722632:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970724992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121155.722672:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121155.722716:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789121155.722722:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970725120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121155.722744:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121155.722770:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3645:1876028970725376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121155.722793:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121155.722812:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789121155.722852:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3645:1876028970725248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121155.722875:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121155.722925:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970724992 00000100:00100000:1.0:1789121155.722930:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970724992 00010000:00010000:1.0:1789121155.722952:0:17840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a2c00/0xb74d2367a83108a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831089d expref: 24 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121155.722969:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970725120 00000100:00100000:1.0:1789121155.722972:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970725120 00010000:00010000:1.0:1789121155.722980:0:17840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310746 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831073f expref: 25 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121155.722989:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970725376 00000100:00100000:1.0:1789121155.722992:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970725376 00010000:00010000:1.0:1789121155.723000:0:17840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946783c3a200/0xb74d2367a83106f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a83106f2 expref: 26 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121155.723007:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970725248 00000100:00100000:1.0:1789121155.723009:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970725248 00010000:00010000:1.0:1789121155.723018:0:17840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff946899a54800/0xb74d2367a8310707 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310700 expref: 27 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121155.723030:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789121155.723035:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+27:3646:x1876028970724992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789121155.723047:0:17840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121155.723052:0:17840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a2c00/0xb74d2367a83108a4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831089d expref: 27 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.723061:0:17840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a2c00/0xb74d2367a83108a4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a831089d expref: 27 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.723090:0:17840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121155.723121:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+27:3646:x1876028970724992:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121155.723129:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789121155.723143:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789121155.723149:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+26:3646:x1876028970725120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789121155.723157:0:17840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121155.723161:0:17840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310746 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a831073f expref: 26 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.723169:0:17840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310746 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a831073f expref: 26 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.723178:0:17840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121155.723199:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+26:3646:x1876028970725120:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121155.723205:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789121155.723216:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789121155.723222:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+25:3645:x1876028970725376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789121155.723229:0:17840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121155.723233:0:17840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946783c3a200/0xb74d2367a83106f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a83106f2 expref: 25 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.723255:0:17840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946783c3a200/0xb74d2367a83106f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a83106f2 expref: 25 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.723265:0:17840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121155.723299:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+25:3645:x1876028970725376:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121155.723305:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789121155.723318:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789121155.723324:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3645:x1876028970725248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789121155.723331:0:17840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121155.723334:0:17840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff946899a54800/0xb74d2367a8310707 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xb74d2367a8310700 expref: 24 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.723342:0:17840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff946899a54800/0xb74d2367a8310707 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xb74d2367a8310700 expref: 24 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.723351:0:17840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121155.723369:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3645:x1876028970725248:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121155.723375:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789121155.723421:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dc3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3645:1876028970725248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121155.723431:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914df840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3645:1876028970725376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121155.723459:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970725120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789121155.723466:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3646:1876028970724992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789121155.723895:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121155.724060:0:20891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a2c00/0xb74d2367a83108a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a831089d expref: 23 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121155.724074:0:20891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7052c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724480:0@lo:104: 00010000:00010000:0.0:1789121155.724085:0:20891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3200/0xb74d2367a8310746 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a831073f expref: 22 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121155.724095:0:20891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf704780 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724608:0@lo:104: 00010000:00010000:0.0:1789121155.724105:0:20891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a54800/0xb74d2367a8310707 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a8310700 expref: 21 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121155.724114:0:20891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf706940 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724736:0@lo:104: 00010000:00010000:0.0:1789121155.724123:0:20891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946783c3a200/0xb74d2367a83106f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xb74d2367a83106f2 expref: 20 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121155.724134:0:20891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf704000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724864:0@lo:104: 00000100:00100000:0.0:1789121155.728077:0:20891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b24000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724224:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789121155.728097:0:20891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf707840 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20891:1876028970724352:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789121155.728144:0:20891:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789121155.731915:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789121155.734668:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121155.734793:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121155.734884:0:17841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947565184 00000100:00100000:3.0:1789121155.734897:0:17841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947565184 00010000:00010000:3.0:1789121155.734998:0:17841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a2400/0xb74d2367a8310a33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee77 expref: 13 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121155.735019:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947565312 00000100:00100000:1.0:1789121155.735025:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947565312 00010000:00010000:1.0:1789121155.735048:0:17840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9468b99a3800/0xb74d2367a83109f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee07 expref: 14 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121155.735055:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:3.0:1789121155.735073:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42aa198-48db-4e57-bdde-271b173b12cf+14:2412:x1876028947565184:12345-192.168.202.32@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789121155.735075:0:17840:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789121155.735089:0:17840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789121155.735098:0:17841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121155.735106:0:17841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a2400/0xb74d2367a8310a33 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee77 expref: 14 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121155.735137:0:17841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a2400/0xb74d2367a8310a33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee77 expref: 14 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121155.735162:0:17841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a2400/0xb74d2367a8310a33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee77 expref: 14 pid: 17847 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121155.735184:0:17841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121155.735269:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839f1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d42aa198-48db-4e57-bdde-271b173b12cf+13:2412:x1876028947565184:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 200us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121155.735276:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 14 00000100:00100000:3.0:1789121155.735284:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 13 00000100:00100000:1.0:1789121155.735290:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf707840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42aa198-48db-4e57-bdde-271b173b12cf+13:2412:x1876028947565312:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789121155.735301:0:17840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121155.735307:0:17840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9468b99a3800/0xb74d2367a83109f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee07 expref: 12 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735320:0:17840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9468b99a3800/0xb74d2367a83109f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee07 expref: 12 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735334:0:17840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9468b99a3800/0xb74d2367a83109f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee07 expref: 12 pid: 17849 timeout: 705 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735347:0:17840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735357:0:17840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735372:0:17840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735381:0:17840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735400:0:17840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735407:0:17840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735413:0:17840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:1.0:1789121155.735425:0:17840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735434:0:17840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735447:0:17840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121155.735459:0:17840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121155.735482:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf707840 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42aa198-48db-4e57-bdde-271b173b12cf+11:2412:x1876028947565312:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 197us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121155.735489:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 14 00010000:00010000:0.0:1789121155.735790:0:20891:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.735813:0:20891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121155.735849:0:20891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff946899a55200/0xb74d2367a8310a64 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121156.564166:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789121157.010915:0:17851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789121157.010930:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468aa987000 from 19 10000000:01000000:1.0:1789121157.010939:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789121157.011008:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121157.011019:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121157.011029:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121157.011057:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970725504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789121157.011148:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121157.011200:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789121157.011215:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970725504 00000100:00100000:3.0:1789121157.011237:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970725504 00000100:00100000:3.0:1789121157.011310:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789121157.011322:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+20:17851:x1876028970725504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121157.011340:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121157.011357:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d1600/0xb74d2367a8310a72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310a6b expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.011390:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d1600/0xb74d2367a8310a72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310a6b expref: 21 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.011402:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d1600/0xb74d2367a8310a72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310a6b expref: 21 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.011413:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1600, rc 0) 00000100:00100000:3.0:1789121157.011585:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5ab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:17851:x1876028970725504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 265us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121157.011593:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789121157.014933:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970725504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789121157.015007:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121157.015023:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121157.015164:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970725632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789121157.015258:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121157.015316:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789121157.015429:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970725632 00000100:00100000:2.0:1789121157.015439:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970725632 00000100:00100000:2.0:1789121157.015549:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789121157.015561:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:17851:x1876028970725632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121157.015724:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5aa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:17851:x1876028970725632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121157.015743:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789121157.017389:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970725632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789121157.017462:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970725760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789121157.017555:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121157.017610:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468852d2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789121157.017688:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970725760 00000100:00100000:0.0:1789121157.017696:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970725760 00000100:00100000:0.0:1789121157.017763:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789121157.017775:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:17851:x1876028970725760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789121157.017970:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5abc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:17851:x1876028970725760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121157.017978:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1789121157.018034:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dde00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970725760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789121157.018957:0:20931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:2.0:1789121157.020559:0:17851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:2.0:1789121157.020635:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789121157.020651:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121157.020690:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468b99a2400/0xb74d2367a8310a6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a72 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789121157.020702:0:17851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789121157.020704:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468c081e000 from 19 10000000:01000000:2.0:1789121157.020706:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789121157.020758:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121157.020766:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121157.020779:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121157.020810:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970725888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789121157.020930:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121157.020981:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970725888 00000100:00100000:2.0:1789121157.020988:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946882b9d780 going to sleep for 11 seconds 00000100:00100000:0.0:1789121157.020989:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970725888 00000100:00100000:0.0:1789121157.021059:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789121157.021071:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+21:17851:x1876028970725888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121157.021089:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121157.021110:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55a00/0xb74d2367a8310a80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310a79 expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121157.021213:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55a00/0xb74d2367a8310a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310a79 expref: 22 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121157.021238:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55a00/0xb74d2367a8310a80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310a79 expref: 22 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121157.021256:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55a00, rc 0) 00000100:00100000:0.0:1789121157.021353:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:17851:x1876028970725888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 283us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121157.021361:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789121157.021439:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2c3c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970725888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121157.021533:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.021544:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121157.021619:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.021653:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121157.021713:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468987379c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789121157.021952:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970726016 00000100:00100000:0.0:1789121157.021959:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970726016 00000100:00100000:0.0:1789121157.022030:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789121157.022039:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:17851:x1876028970726016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789121157.022199:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:17851:x1876028970726016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 161us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121157.022206:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789121157.022339:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.022377:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.022431:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121157.022467:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468987379c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789121157.022480:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970726144 00000100:00100000:3.0:1789121157.022484:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970726144 00000100:00100000:3.0:1789121157.022505:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789121157.022511:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:17851:x1876028970726144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.022596:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:17851:x1876028970726144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121157.022604:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789121157.022646:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789121157.023691:0:20932:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789121157.023932:0:17851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789121157.023957:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789121157.023969:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.023988:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9468aa990a00/0xb74d2367a8310a79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a80 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121157.024002:0:17851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789121157.024005:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9468b9c33800 from 19 10000000:01000000:3.0:1789121157.024009:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789121157.024052:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.024059:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.024072:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121157.024098:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.024291:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121157.024323:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946898737a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789121157.024347:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970726272 00000100:00100000:3.0:1789121157.024353:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970726272 00000100:00100000:3.0:1789121157.024395:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789121157.024405:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bc5a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+22:17851:x1876028970726272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121157.024420:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121157.024435:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9467838d0600/0xb74d2367a8310a8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310a87 expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.024475:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9467838d0600/0xb74d2367a8310a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310a87 expref: 23 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.024499:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9467838d0600/0xb74d2367a8310a8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310a87 expref: 23 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.024509:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0600, rc 0) 00000100:00100000:3.0:1789121157.024549:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bc5a9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:17851:x1876028970726272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121157.024557:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789121157.024609:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121157.024624:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.024634:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121157.024696:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.024736:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121157.024751:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946898737a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789121157.024762:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970726400 00000100:00100000:3.0:1789121157.024765:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970726400 00000100:00100000:3.0:1789121157.024781:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789121157.024799:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:17851:x1876028970726400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.024963:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:17851:x1876028970726400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121157.024970:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789121157.024997:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.025034:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.025078:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121157.025092:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff946898737a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789121157.025104:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970726528 00000100:00100000:3.0:1789121157.025107:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970726528 00000100:00100000:3.0:1789121157.025123:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789121157.025142:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:17851:x1876028970726528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.025222:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:17851:x1876028970726528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121157.025242:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1789121157.025283:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789121157.031989:0:20934:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:3.0:1789121157.032304:0:17851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:3.0:1789121157.032336:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789121157.032361:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.032375:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9467838d0000/0xb74d2367a8310a87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a8e expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789121157.032386:0:17851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789121157.032388:0:17851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff946784ac0800 from 19 10000000:01000000:3.0:1789121157.032391:0:17851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789121157.032435:0:17851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.032441:0:17851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.032466:0:17851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121157.032502:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.032590:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121157.032636:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b33840 going to sleep for 11 seconds 00000100:00100000:2.0:1789121157.032719:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970726656 00000100:00100000:2.0:1789121157.032728:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970726656 00000100:00100000:2.0:1789121157.032795:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789121157.032806:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+23:17851:x1876028970726656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789121157.032855:0:17847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121157.032872:0:17847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468aa990200/0xb74d2367a8310a9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb74d2367a8310a95 expref: -99 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121157.032902:0:17847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468aa990200/0xb74d2367a8310a9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xb74d2367a8310a95 expref: 24 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121157.032917:0:17847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468aa990200/0xb74d2367a8310a9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xb74d2367a8310a95 expref: 24 pid: 17847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121157.032927:0:17847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa990200, rc 0) 00000100:00100000:2.0:1789121157.032966:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:17851:x1876028970726656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121157.032972:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789121157.036881:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789121157.036928:0:17851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121157.036946:0:17851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121157.037065:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.037151:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121157.037214:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b33840 going to sleep for 11 seconds 00000100:00100000:2.0:1789121157.037306:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970726784 00000100:00100000:2.0:1789121157.037314:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970726784 00000100:00100000:2.0:1789121157.037386:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789121157.037399:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:17851:x1876028970726784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789121157.037569:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:17851:x1876028970726784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 172us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121157.037578:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789121157.037718:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.037753:0:17851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789121157.037810:0:17851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121157.037862:0:17851:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468b6b33840 going to sleep for 11 seconds 00000100:00100000:1.0:1789121157.037951:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970726912 00000100:00100000:1.0:1789121157.037956:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970726912 00000100:00100000:1.0:1789121157.037987:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789121157.037995:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:17851:x1876028970726912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789121157.038091:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:17851:x1876028970726912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 96us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121157.038098:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789121157.038191:0:17851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b061c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:17851:1876028970726912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789121157.039505:0:20936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 19 00000020:01000000:1.0:1789121157.039758:0:17851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 19-18 (rc=0) 10000000:01000000:1.0:1789121157.039785:0:17851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.132@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789121157.039800:0:17851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121157.039812:0:17851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.132@tcp lock: ffff9467838d0e00/0xb74d2367a8310a95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xb74d2367a8310a9c expref: -99 pid: 17851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121157.327345:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121157.327767:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947565440 00000100:00100000:1.0:1789121157.327780:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947565440 00000100:00100000:1.0:1789121157.327899:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 158 00000100:00100000:1.0:1789121157.327913:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+11:15209:x1876028947565440:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789121157.327936:0:17848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121157.327960:0:17848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9468b99a2200/0xb74d2367a8310aa3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eeaf expref: -99 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121157.327996:0:17848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9468b99a2200/0xb74d2367a8310aa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eeaf expref: 12 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121157.329369:0:17848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9468b99a2200/0xb74d2367a8310aa3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eeaf expref: 12 pid: 17848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121157.329384:0:17848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2200, rc 0) 00000100:00100000:1.0:1789121157.329475:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+12:15209:x1876028947565440:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 1565us (2143us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121157.329486:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 158 00000100:00100000:3.0:1789121157.340774:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121157.344547:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947565568 00000100:00100000:0.0:1789121157.344570:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947565568 00000100:00100000:0.0:1789121157.344656:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 159 00000100:00100000:0.0:1789121157.344668:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+12:15209:x1876028947565568:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789121157.345647:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+12:15209:x1876028947565568:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 974us (4881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121157.345658:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 159 00000100:00100000:3.0:1789121157.349852:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121157.350000:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947565696 00000100:00100000:2.0:1789121157.350013:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947565696 00000100:00100000:2.0:1789121157.350081:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 160 00000100:00100000:2.0:1789121157.350093:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+12:15209:x1876028947565696:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789121157.351609:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+12:15209:x1876028947565696:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 1505us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121157.351624:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 160 00000100:00100000:3.0:1789121157.363371:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121157.363452:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947565824 00000100:00100000:0.0:1789121157.363463:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947565824 00000100:00100000:0.0:1789121157.363529:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 161 00000100:00100000:0.0:1789121157.363541:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+12:15209:x1876028947565824:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789121157.363563:0:17849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121157.363594:0:17849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff946899a55e00/0xb74d2367a8310aaa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eeb6 expref: -99 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121157.363630:0:17849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff946899a55e00/0xb74d2367a8310aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eeb6 expref: 13 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121157.363644:0:17849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff946899a55e00/0xb74d2367a8310aaa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eeb6 expref: 13 pid: 17849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121157.363655:0:17849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff946899a55e00, rc 0) 00000100:00100000:0.0:1789121157.363730:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+13:15209:x1876028947565824:12345-192.168.202.32@tcp:101:ll_cfg_requeue.0 Request processed in 191us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121157.363737:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 161 00000100:00100000:0.0:1789121157.383891:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121157.386299:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947565952 00000100:00100000:0.0:1789121157.386319:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947565952 00000100:00100000:0.0:1789121157.387286:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 162 00000100:00100000:0.0:1789121157.387302:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+13:15209:x1876028947565952:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789121157.387713:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+13:15209:x1876028947565952:12345-192.168.202.32@tcp:501:ll_cfg_requeue.0 Request processed in 414us (3835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121157.387723:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 162 00000100:00100000:0.0:1789121157.393862:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121157.393915:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947566080 00000100:00100000:0.0:1789121157.393928:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947566080 00000100:00100000:0.0:1789121157.393989:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 163 00000100:00100000:0.0:1789121157.394001:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+13:15209:x1876028947566080:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789121157.394190:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d42aa198-48db-4e57-bdde-271b173b12cf+13:15209:x1876028947566080:12345-192.168.202.32@tcp:503:ll_cfg_requeue.0 Request processed in 191us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121157.394206:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 163 00010000:00010000:3.0:1789121157.587286:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121158.034769:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789121158.034800:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970727040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789121158.034911:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121158.034972:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970727040 00000100:00100000:1.0:1789121158.034981:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970727040 00000100:00100000:1.0:1789121158.035052:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789121158.035080:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970727040:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789121158.035274:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:1.0:1789121158.035339:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121158.035505:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970727040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 428us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121158.035515:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121158.036058:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970727296:0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.036103:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121158.036145:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946889570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970727808:0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.036184:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121158.036202:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970728320:0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.036239:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121158.036262:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1789121158.036268:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970727424:0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.036292:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121158.036307:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970727936:0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.036326:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121158.036343:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970728448:0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.036583:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121158.036646:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970727296 00000100:00100000:2.0:1789121158.036654:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970727296 00000100:00100000:2.0:1789121158.036704:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789121158.036713:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970727296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.036769:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5d2c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970727296:12345-0@lo:400:kworker.0 Request processed in 56us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121158.036776:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1789121158.036802:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970727808 00000100:00100000:2.0:1789121158.036805:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970727808 00000100:00100000:2.0:1789121158.036876:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970727424 00000100:00100000:2.0:1789121158.036880:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970727424 00000100:00100000:2.0:1789121158.036893:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970727936 00000100:00100000:2.0:1789121158.036896:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970727936 00000100:00100000:2.0:1789121158.036913:0:20006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789121158.036919:0:20006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970727808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.036951:0:20006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970727808:12345-0@lo:400:kworker.0 Request processed in 32us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121158.036970:0:20006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789121158.036982:0:20006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121158.036988:0:20006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970727424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.037018:0:20006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970727424:12345-0@lo:400:kworker.0 Request processed in 30us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121158.037024:0:20006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789121158.037036:0:20006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121158.037042:0:20006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970727936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.037068:0:20006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970727936:12345-0@lo:400:kworker.0 Request processed in 27us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121158.037075:0:20006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789121158.037094:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970728320 00000100:00100000:2.0:1789121158.037097:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970728320 00000100:00100000:1.0:1789121158.037283:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970727168:0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.037329:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121158.037372:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970727680:0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.037400:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121158.037418:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970728192:0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.037457:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121158.037513:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dcb40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970727040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789121158.037540:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1789121158.037548:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970727552:0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.037574:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121158.037592:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970728064:0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.037614:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121158.037630:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970728576:0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.037671:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121158.037694:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970728448 00000100:00100000:1.0:1789121158.037698:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970728448 00000100:00100000:1.0:1789121158.037723:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970728192 00000100:00100000:1.0:1789121158.037726:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970728192 00000100:00100000:1.0:1789121158.037739:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970727552 00000100:00100000:1.0:1789121158.037742:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970727552 00000100:00100000:1.0:1789121158.037752:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970728064 00000100:00100000:1.0:1789121158.037754:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970728064 00000100:00100000:1.0:1789121158.037763:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970728576 00000100:00100000:1.0:1789121158.037766:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970728576 00000100:00100000:1.0:1789121158.037782:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789121158.037789:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970728448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.037846:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1876028970728448:12345-0@lo:400:kworker.0 Request processed in 57us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121158.037860:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789121158.037874:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789121158.037880:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970728192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.037916:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dde00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1876028970728192:12345-0@lo:400:kworker.0 Request processed in 36us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121158.037922:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789121158.037933:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789121158.037939:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970727552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.037964:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dcb40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1876028970727552:12345-0@lo:400:kworker.0 Request processed in 26us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121158.037969:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789121158.037980:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789121158.037984:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970728064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.038007:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dd680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1876028970728064:12345-0@lo:400:kworker.0 Request processed in 23us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121158.038013:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789121158.038023:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789121158.038029:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970728576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.038056:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1876028970728576:12345-0@lo:400:kworker.0 Request processed in 27us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121158.038061:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789121158.038096:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2ed00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3647:1876028970727552:0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.038106:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3647:1876028970728064:0@lo:400:kworker.0 00010000:00080000:1.0:1789121158.038133:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5e580 x1876028970728576/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121158.038151:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5e580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3647:1876028970728576:0@lo:400:kworker.0 00000100:00100000:1.0:1789121158.038165:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5c780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3647:1876028970728192:0@lo:400:kworker.0 00000100:00100000:0.0:1789121158.038676:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970727168 00000100:00100000:0.0:1789121158.038684:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970727168 00000100:00100000:0.0:1789121158.038732:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789121158.038740:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970727168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121158.038796:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3647:x1876028970727168:12345-0@lo:400:kworker.0 Request processed in 58us (1467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121158.038803:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789121158.038874:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970727680 00000100:00100000:0.0:1789121158.038879:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970727680 00000100:00100000:0.0:1789121158.038907:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789121158.038914:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970727680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789121158.038950:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970727680:12345-0@lo:400:kworker.0 Request processed in 37us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121158.038957:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789121158.038975:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789121158.038980:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789121158.038984:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789121158.038987:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789121158.039020:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3647:1876028970727168:0@lo:400:kworker.0 00000100:00100000:0.0:1789121158.039033:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946893a7f0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970727680:0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.039861:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789121158.039876:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970728320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.039937:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5fc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1876028970728320:12345-0@lo:400:kworker.0 Request processed in 68us (3698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121158.039945:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789121158.040092:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970727424:0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.040108:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970727936:0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.040134:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5cf00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3644:1876028970728448:0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.040148:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783c2e940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970727296:0@lo:400:kworker.0 00000100:00100000:2.0:1789121158.040163:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946889570780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970727808:0@lo:400:kworker.0 00010000:00080000:2.0:1789121158.040194:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff946783d5de00 x1876028970728320/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789121158.040206:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5de00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3644:1876028970728320:0@lo:400:kworker.0 00000100:00100000:0.0:1789121158.040384:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789121158.040406:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970728704:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789121158.040462:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121158.040503:0:19370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970728704 00000100:00100000:0.0:1789121158.040509:0:19370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970728704 00000100:00100000:0.0:1789121158.040543:0:19370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789121158.040549:0:19370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970728704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789121158.040568:0:19370:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:0.0:1789121158.040604:0:19370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970728704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 56us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121158.040611:0:19370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789121158.040657:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970728704:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1789121158.612530:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121159.118698:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121159.118758:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121159.118807:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121159.118875:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121159.118898:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121159.118919:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121159.118942:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121159.118963:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121159.118991:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121159.119012:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947566720 00000100:00100000:3.0:1789121159.119026:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947566720 00000100:00100000:0.0:1789121159.119033:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947566464 00000100:00100000:0.0:1789121159.119039:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947566464 00000100:00100000:3.0:1789121159.119105:0:20006:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947567232 00000100:00100000:1.0:1789121159.119109:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947566976 00000100:00100000:3.0:1789121159.119110:0:20006:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947567232 00000100:00100000:1.0:1789121159.119116:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947566976 00000100:00100000:2.0:1789121159.119176:0:17848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947566208 00000100:00100000:2.0:1789121159.119181:0:17848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947566208 00000100:00100000:2.0:1789121159.119235:0:17848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 165 00000100:00100000:2.0:1789121159.119247:0:17848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+13:2410:x1876028947566208:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121159.119343:0:17848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d42aa198-48db-4e57-bdde-271b173b12cf+13:2410:x1876028947566208:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 97us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121159.119353:0:17848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 165 00000100:00100000:2.0:1789121159.119392:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947566336 00000100:00100000:2.0:1789121159.119396:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947566336 00000100:00100000:0.0:1789121159.119675:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947566848 00000100:00100000:0.0:1789121159.119679:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947566848 00000100:00100000:0.0:1789121159.119698:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:0.0:1789121159.119706:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2410:x1876028947566464:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121159.119745:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2410:x1876028947566464:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 40us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121159.119948:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:0.0:1789121159.119965:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:0.0:1789121159.119977:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2410:x1876028947566848:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121159.120019:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2410:x1876028947566848:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 30us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121159.120027:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:0.0:1789121159.120052:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947566592 00000100:00100000:0.0:1789121159.120056:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947566592 00000100:00100000:0.0:1789121159.120074:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947567104 00000100:00100000:0.0:1789121159.120077:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947567104 00000100:00100000:0.0:1789121159.120092:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:0.0:1789121159.120099:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468909d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2410:x1876028947566720:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121159.120127:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468909d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2410:x1876028947566720:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 28us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121159.120134:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:0.0:1789121159.120305:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:0.0:1789121159.120313:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2410:x1876028947566592:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121159.120339:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2410:x1876028947566592:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 27us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121159.120346:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:0.0:1789121159.120357:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:0.0:1789121159.120363:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2410:x1876028947567104:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121159.120386:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3ad00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2410:x1876028947567104:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 23us (1396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121159.120403:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00080000:0.0:1789121159.120676:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789121159.120682:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789121159.120685:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789121159.120688:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789121159.122265:0:20006:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:1.0:1789121159.122265:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:1.0:1789121159.122287:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf706940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2410:x1876028947566976:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121159.122288:0:20006:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf704780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2410:x1876028947567232:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:1.0:1789121159.122382:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf706940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2410:x1876028947566976:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 104us (3505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121159.122393:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:2.0:1789121159.122591:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:2.0:1789121159.122601:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946893a7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2410:x1876028947566336:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:3.0:1789121159.123802:0:20006:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf704780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2410:x1876028947567232:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 1514us (4892us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121159.123815:0:20006:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:2.0:1789121159.124055:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946893a7f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2410:x1876028947566336:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 1453us (5131us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121159.124065:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00010000:00010000:3.0:1789121159.634262:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789121159.872924:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121159.873100:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947567360 00000100:00100000:2.0:1789121159.873120:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947567360 00000100:00100000:2.0:1789121159.873223:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:2.0:1789121159.873237:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:15880:x1876028947567360:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789121159.873271:0:17855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121159.873305:0:17855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ab1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eebd expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.873649:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310ab8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.873670:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.873688:0:17855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.873707:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310abf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.873714:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.873722:0:17855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.873897:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990600/0xb74d2367a8310ac6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.873906:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990600/0xb74d2367a8310ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.873914:0:17855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990600/0xb74d2367a8310ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121159.873952:0:17855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789121159.873959:0:17855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121159.874014:0:17855:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990600/0xb74d2367a8310ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874042:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874049:0:17855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874056:0:17855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874063:0:17855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121159.874069:0:17855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874092:0:17855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874114:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946888a7f600) 00010000:00010000:2.0:1789121159.874118:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121159.874124:0:17855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310ab8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874131:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310ab8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874149:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310abf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874155:0:17855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310abf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874161:0:17855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310abf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874173:0:17855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121159.874176:0:17855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310abf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874182:0:17855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310abf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874191:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff946888a7ff00) 00010000:00010000:2.0:1789121159.874193:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121159.874207:0:17855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310abf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874214:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310abf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874265:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ab1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eebd expref: 8 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874281:0:17855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990600/0xb74d2367a8310ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eebd expref: 7 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121159.874289:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff946888a7fc00) 00010000:00010000:2.0:1789121159.874292:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789121159.874295:0:17855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa990600, rc 0) 00000100:00100000:2.0:1789121159.874697:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:15880:x1876028947567360:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1461us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121159.874709:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:0.0:1789121159.889336:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121159.889486:0:17865:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947567488 00000100:00100000:1.0:1789121159.889499:0:17865:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947567488 00000100:00100000:1.0:1789121159.889611:0:17865:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:1.0:1789121159.889624:0:17865:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:15880:x1876028947567488:12345-192.168.202.32@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789121159.889746:0:17865:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38780 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:15880:x1876028947567488:12345-192.168.202.32@tcp:900:lhsmtool_posix.0 Request processed in 124us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121159.889756:0:17865:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:1.0:1789121159.895780:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121159.895943:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947567744 00000100:00100000:0.0:1789121159.896149:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947567744 00000100:00100000:0.0:1789121159.896254:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:0.0:1789121159.896269:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:15880:x1876028947567744:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789121159.896302:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121159.896337:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a8310acd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eec4 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.896448:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310ad4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.896469:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.896483:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.896536:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a8310adb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.896546:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a8310adb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.896568:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a8310adb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.896709:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8310ae2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.896717:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8310ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.896725:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8310ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121159.896737:0:19755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1789121159.896983:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897001:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310ad4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897008:0:19755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897016:0:19755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff946899a55200 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121159.897021:0:19755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897030:0:19755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310ad4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897044:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff946888a7fc00) 00010000:00010000:0.0:1789121159.897398:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121159.897413:0:19755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310ad4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897422:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a55200/0xb74d2367a8310ad4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897442:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a8310adb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897449:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a8310adb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897455:0:19755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a8310adb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897462:0:19755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ad600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121159.897465:0:19755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a8310adb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897472:0:19755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a8310adb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897481:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9468b9862800) 00010000:00010000:0.0:1789121159.897483:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121159.897486:0:19755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a8310adb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.897492:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad600/0xb74d2367a8310adb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.914514:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff946899a54800/0xb74d2367a8310acd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eec4 expref: 10 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.914579:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9acc00/0xb74d2367a8310ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eec4 expref: 9 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.914591:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9468b9862d00) 00010000:00010000:0.0:1789121159.914595:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121159.914599:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9acc00, rc 0) 00000100:00100000:0.0:1789121159.914730:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914de1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+9:15880:x1876028947567744:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 18463us (18967us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789121159.914754:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:0.0:1789121159.919120:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121159.919358:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947567872 00000100:00100000:3.0:1789121159.919371:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947567872 00000100:00100000:3.0:1789121159.919452:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:3.0:1789121159.919465:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+9:15880:x1876028947567872:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789121159.919618:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c38f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+9:15880:x1876028947567872:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 Request processed in 155us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121159.919628:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 25 00000100:00100000:0.0:1789121159.928008:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121159.932264:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947568000 00000100:00100000:2.0:1789121159.932310:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947568000 00000100:00100000:2.0:1789121159.933181:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:2.0:1789121159.933211:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:15880:x1876028947568000:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 00000004:00080000:1.0:1789121159.937319:0:17855:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 4040us 00000100:00100000:1.0:1789121159.973028:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:15880:x1876028947568000:12345-192.168.202.32@tcp:59:lhsmtool_posix.0 Request processed in 39814us (45016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121159.973051:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:1.0:1789121159.989482:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121159.989605:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947568128 00000100:00100000:0.0:1789121159.989619:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947568128 00000100:00100000:0.0:1789121159.989702:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:0.0:1789121159.989714:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+9:15886:x1876028947568128:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:0.0:1789121159.989744:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121159.989777:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad200/0xb74d2367a8310af0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eecb expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.989926:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad400/0xb74d2367a8310af7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.989947:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad400/0xb74d2367a8310af7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.989964:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad400/0xb74d2367a8310af7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.989997:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ade00/0xb74d2367a8310afe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990005:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ade00/0xb74d2367a8310afe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990013:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ade00/0xb74d2367a8310afe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990088:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad400/0xb74d2367a8310af7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990097:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad400/0xb74d2367a8310af7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990105:0:19755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad400/0xb74d2367a8310af7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990112:0:19755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ad400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121159.990116:0:19755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad400/0xb74d2367a8310af7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990124:0:19755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad400/0xb74d2367a8310af7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990139:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946888a7f600) 00010000:00010000:0.0:1789121159.990144:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121159.990150:0:19755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad400/0xb74d2367a8310af7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990157:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad400/0xb74d2367a8310af7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990190:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ade00/0xb74d2367a8310afe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990211:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ade00/0xb74d2367a8310afe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990217:0:19755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ade00/0xb74d2367a8310afe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990223:0:19755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ade00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121159.990226:0:19755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ade00/0xb74d2367a8310afe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990232:0:19755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ade00/0xb74d2367a8310afe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990241:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9468b9862a00) 00010000:00010000:0.0:1789121159.990244:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121159.990247:0:19755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ade00/0xb74d2367a8310afe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990253:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ade00/0xb74d2367a8310afe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990293:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad200/0xb74d2367a8310af0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eecb expref: 10 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990305:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946888a7f600) 00010000:00010000:0.0:1789121159.990307:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789121159.990318:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad200/0xb74d2367a8310af0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eecb expref: 10 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121159.990329:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ad200, rc 0) 00000100:00100000:0.0:1789121159.990421:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+9:15886:x1876028947568128:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 707us (954us total) trans 0 rc 301/301 00000100:00100000:0.0:1789121159.990429:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:0.0:1789121160.014286:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121160.014439:0:17863:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947568256 00000100:00100000:1.0:1789121160.014454:0:17863:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947568256 00000100:00100000:1.0:1789121160.014661:0:17863:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:1.0:1789121160.014676:0:17863:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+9:15886:x1876028947568256:12345-192.168.202.32@tcp:700:lfs.0 00000100:00100000:1.0:1789121160.014857:0:17863:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+9:15886:x1876028947568256:12345-192.168.202.32@tcp:700:lfs.0 Request processed in 147us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121160.014868:0:17863:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:3.0:1789121160.018330:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.021659:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947568512 00000100:00100000:2.0:1789121160.021678:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947568512 00000100:00100000:2.0:1789121160.021799:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:2.0:1789121160.021812:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+9:15886:x1876028947568512:12345-192.168.202.32@tcp:36:lfs.0 00010000:00010000:2.0:1789121160.021947:0:19756:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121160.021989:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310a1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ee38 expref: 9 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.022014:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946888a7f600) 00010000:00010000:2.0:1789121160.022019:0:19756:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789121160.022107:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.022123:0:19756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eea8 expref: 5 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.022133:0:19756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.022170:0:19756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eea8 expref: 5 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.022183:0:19756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eea8 expref: 5 pid: 17856 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121160.022233:0:19756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5de00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19756:1876028970728832:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789121160.022368:0:19756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afc01300 going to sleep for 11 seconds 00000100:00100000:1.0:1789121160.027416:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.027446:0:19756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5de00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19756:1876028970728832:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789121160.027547:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947568640 00000100:00100000:3.0:1789121160.027558:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947568640 00010000:00010000:3.0:1789121160.027630:0:17840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eea8 expref: 6 pid: 17856 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121160.027682:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 15 00000100:00100000:3.0:1789121160.027695:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2411:x1876028947568640:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789121160.027983:0:19756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.028316:0:17840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789121160.028327:0:17840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eea8 expref: 6 pid: 17856 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.028341:0:17840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eea8 expref: 6 pid: 17856 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.028373:0:17840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310a5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eea8 expref: 6 pid: 17856 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.028393:0:17840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946888a7f600) 00010000:00010000:3.0:1789121160.028400:0:17840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.028412:0:17840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.028420:0:17840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.028454:0:17840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789121160.028631:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2411:x1876028947568640:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 936us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121160.028643:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 15 00010000:00010000:2.0:1789121160.028935:0:19756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.028942:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.028976:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.028984:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.028990:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033499:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033539:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033555:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789121160.033594:0:19756:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000093b82735 reply state 0000000036d4e9b6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033609:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033617:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:2.0:1789121160.033620:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789121160.033627:0:19756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789121160.033636:0:19756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789121160.033647:0:19756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033654:0:19756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033662:0:19756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033669:0:19756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121160.033674:0:19756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033683:0:19756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033695:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946888a7f600) 00010000:00010000:2.0:1789121160.033698:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121160.033701:0:19756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033718:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b05 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789121160.033746:0:19756:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000093b82735 reply state 0000000036d4e9b6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033755:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.033761:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff946888a7ff00) 00010000:00010000:2.0:1789121160.033763:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789121160.033766:0:19756:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1789121160.033945:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b061c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+10:15886:x1876028947568512:12345-192.168.202.32@tcp:36:lfs.0 Request processed in 12129us (15624us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789121160.033956:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:2.0:1789121160.082683:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783b04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970728960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789121160.082785:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121160.083000:0:19370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970728960 00000100:00100000:3.0:1789121160.083010:0:19370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970728960 00000100:00100000:3.0:1789121160.083089:0:19370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789121160.083103:0:19370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970728960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789121160.083143:0:19370:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1789121160.083227:0:19370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5de00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970728960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121160.083235:0:19370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1789121160.084337:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121160.084409:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783b04f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970728960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789121160.084443:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789121160.084451:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970729088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789121160.084505:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789121160.084608:0:19370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970729088 00000100:00100000:0.0:1789121160.084615:0:19370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970729088 00000100:00100000:0.0:1789121160.084689:0:19370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789121160.084698:0:19370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970729088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789121160.084719:0:19370:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1789121160.084762:0:19370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5cf00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3644:x1876028970729088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121160.084770:0:19370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789121160.084793:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c38b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3644:1876028970729088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789121160.084815:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121160.085653:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970729344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789121160.085739:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468914dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970729216:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121160.085788:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121160.085874:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970729216 00000100:00100000:2.0:1789121160.085880:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970729216 00000100:00100000:2.0:1789121160.085920:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789121160.085928:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970729216:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789121160.086121:0:17859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789121160.086173:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970729216:12345-0@lo:41:osp-pre-0-1.0 Request processed in 246us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121160.086181:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789121160.086237:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468914dc780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970729216:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789121160.086304:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121160.086464:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970729344 00000100:00100000:2.0:1789121160.086468:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970729344 00000100:00100000:2.0:1789121160.086516:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789121160.086524:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970729344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789121160.086546:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789121160.086588:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970729344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121160.086595:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789121160.086626:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970729344:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789121160.116673:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.119590:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947568768 00000100:00100000:2.0:1789121160.119620:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947568768 00000100:00100000:1.0:1789121160.119904:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:1.0:1789121160.119919:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+10:15894:x1876028947568768:12345-192.168.202.32@tcp:101:lctl.0 00010000:00010000:1.0:1789121160.119956:0:17855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121160.119995:0:17855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8310b1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eed2 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.120094:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2800/0xb74d2367a8310b21 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.120110:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2800/0xb74d2367a8310b21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.120123:0:17855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2800/0xb74d2367a8310b21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789121160.120180:0:17855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789121160.120184:0:17855:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789121160.120238:0:17855:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2800/0xb74d2367a8310b21 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.120286:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8310b1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eed2 expref: 12 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.120306:0:17855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2800/0xb74d2367a8310b21 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eed2 expref: 11 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.120314:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946782181e00) 00010000:00010000:1.0:1789121160.120317:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789121160.120320:0:17855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a2800, rc 0) 00000100:00100000:1.0:1789121160.120400:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+11:15894:x1876028947568768:12345-192.168.202.32@tcp:101:lctl.0 Request processed in 485us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121160.120412:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000040:00080000:0.0:1789121160.146721:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789121160.179100:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121160.179286:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947568896 00000100:00100000:3.0:1789121160.179298:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947568896 00000100:00100000:3.0:1789121160.179378:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:3.0:1789121160.179392:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:15895:x1876028947568896:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789121160.179421:0:17856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121160.179451:0:17856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310b28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eed9 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.179542:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8310b2f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.179574:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8310b2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.179590:0:17856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8310b2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789121160.180094:0:17856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789121160.180100:0:17856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789121160.180135:0:17856:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8310b2f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.180171:0:17856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310b28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eed9 expref: 7 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.180205:0:17856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0800/0xb74d2367a8310b2f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eed9 expref: 6 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.180234:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946782181e00) 00010000:00010000:3.0:1789121160.180237:0:17856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789121160.180242:0:17856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0800, rc 0) 00000100:00100000:3.0:1789121160.180334:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:15895:x1876028947568896:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 945us (1249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121160.180343:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:3.0:1789121160.185131:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.185400:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947569024 00000100:00100000:2.0:1789121160.185415:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947569024 00000100:00100000:2.0:1789121160.186109:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:2.0:1789121160.186125:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:15895:x1876028947569024:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789121160.186157:0:19756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121160.186185:0:19756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eee0 expref: -99 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186316:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186347:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186361:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186375:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186382:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186388:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186479:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310b4b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186488:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310b4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186495:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310b4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121160.186557:0:19756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789121160.186561:0:19756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121160.186591:0:19756:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310b4b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186628:0:19756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186635:0:19756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b3d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186643:0:19756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186650:0:19756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121160.186655:0:19756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186664:0:19756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186679:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946782181e00) 00010000:00010000:2.0:1789121160.186682:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121160.186688:0:19756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186695:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186712:0:19756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186718:0:19756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186723:0:19756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186736:0:19756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121160.186739:0:19756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186746:0:19756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186755:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff946888a7ff00) 00010000:00010000:2.0:1789121160.186758:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121160.186761:0:19756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186767:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186812:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eee0 expref: 8 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186861:0:19756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310b4b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eee0 expref: 7 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.186869:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:2.0:1789121160.186871:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789121160.186874:0:19756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991000, rc 0) 00000100:00100000:2.0:1789121160.186980:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b070c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+7:15895:x1876028947569024:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 850us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121160.186990:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:1.0:1789121160.197602:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.197708:0:17866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947569152 00000100:00100000:0.0:1789121160.197719:0:17866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947569152 00000100:00100000:0.0:1789121160.197780:0:17866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:0.0:1789121160.197789:0:17866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:15895:x1876028947569152:12345-192.168.202.32@tcp:900:lfs.0 00000100:00100000:0.0:1789121160.197929:0:17866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:15895:x1876028947569152:12345-192.168.202.32@tcp:900:lfs.0 Request processed in 138us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121160.197940:0:17866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:0.0:1789121160.200522:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.200759:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947569408 00000100:00100000:2.0:1789121160.201083:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947569408 00000100:00100000:2.0:1789121160.201158:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:2.0:1789121160.201170:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+7:15895:x1876028947569408:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789121160.201212:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121160.201243:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eee7 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121160.201382:0:19755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789121160.201519:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eee7 expref: 9 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.201537:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946782181e00) 00010000:00010000:2.0:1789121160.201540:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789121160.201723:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eee7 expref: 9 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.201743:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991a00, rc 0) 00000100:00100000:2.0:1789121160.202145:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+8:15895:x1876028947569408:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 974us (1634us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789121160.202156:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 32 00000100:00100000:3.0:1789121160.204909:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121160.204995:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947569664 00000100:00100000:1.0:1789121160.205009:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947569664 00000100:00100000:1.0:1789121160.207592:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:1.0:1789121160.207622:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+8:15895:x1876028947569664:12345-192.168.202.32@tcp:36:lfs.0 00010000:00010000:1.0:1789121160.207702:0:17856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121160.207740:0:17856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310b4b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eee0 expref: 8 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.207989:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:1.0:1789121160.207996:0:17856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789121160.208030:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.208066:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.208078:0:17856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789121160.208426:0:17856:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000006e55c65e reply state 0000000062572774 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.208443:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.208450:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:1.0:1789121160.208453:0:17856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:1.0:1789121160.208457:0:17856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789121160.208467:0:17856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1789121160.208591:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b06580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0d1c643e-f8d1-4998-bc1e-8baa38374a62+9:15895:x1876028947569664:12345-192.168.202.32@tcp:36:lfs.0 Request processed in 983us (3695us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789121160.208601:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 33 00000100:00100000:1.0:1789121160.211022:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.211124:0:17858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947569920 00000100:00100000:0.0:1789121160.211153:0:17858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947569920 00000100:00100000:0.0:1789121160.211229:0:17858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:0.0:1789121160.211243:0:17858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+9:15895:x1876028947569920:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789121160.211985:0:17858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+10:15895:x1876028947569920:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 741us (972us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789121160.211997:0:17858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:0.0:1789121160.215689:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.215871:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947570176 00000100:00100000:2.0:1789121160.215886:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947570176 00000100:00100000:2.0:1789121160.215967:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:2.0:1789121160.215980:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+10:15895:x1876028947570176:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789121160.216014:0:19756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121160.216043:0:19756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eeee expref: -99 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216170:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b6e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216190:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216216:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216230:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b75 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216239:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216246:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121160.216373:0:19756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1789121160.216474:0:19756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b6e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216483:0:19756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b6e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216491:0:19756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216498:0:19756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121160.216503:0:19756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b6e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216524:0:19756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b6e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216541:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946782181e00) 00010000:00010000:2.0:1789121160.216544:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121160.216551:0:19756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216558:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310b6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216575:0:19756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b75 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216582:0:19756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b75 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216588:0:19756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216593:0:19756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991600 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121160.216597:0:19756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b75 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216604:0:19756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b75 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216611:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff946888a7ff00) 00010000:00010000:2.0:1789121160.216614:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121160.216616:0:19756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b75 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216635:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216676:0:19756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b67 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eeee expref: 12 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216687:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946782181e00) 00010000:00010000:2.0:1789121160.216689:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789121160.216693:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eeee expref: 12 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.216702:0:19756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991a00, rc 0) 00000100:00100000:2.0:1789121160.217118:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c392c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0d1c643e-f8d1-4998-bc1e-8baa38374a62+11:15895:x1876028947570176:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1137us (1439us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1789121160.217127:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 34 00000100:00100000:3.0:1789121160.222975:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.223049:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947570304 00000100:00100000:2.0:1789121160.223061:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947570304 00000100:00100000:2.0:1789121160.223134:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:2.0:1789121160.223146:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+11:15895:x1876028947570304:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789121160.223179:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121160.223215:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b83 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eef5 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.223347:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.223364:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.223393:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121160.223424:0:19755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789121160.223428:0:19755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121160.223451:0:19755:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.223478:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310b83 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eef5 expref: 13 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.223496:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eef5 expref: 12 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.223505:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:2.0:1789121160.223508:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789121160.223512:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991600, rc 0) 00000100:00100000:2.0:1789121160.223596:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0d1c643e-f8d1-4998-bc1e-8baa38374a62+12:15895:x1876028947570304:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 452us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121160.223605:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 35 00000100:00100000:3.0:1789121160.228948:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121160.229004:0:17857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947570432 00000100:00100000:1.0:1789121160.229017:0:17857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947570432 00000100:00100000:1.0:1789121160.229098:0:17857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:1.0:1789121160.229113:0:17857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d1c643e-f8d1-4998-bc1e-8baa38374a62+12:15895:x1876028947570432:12345-192.168.202.32@tcp:37:lfs.0 00000100:00100000:1.0:1789121160.247364:0:17857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0d1c643e-f8d1-4998-bc1e-8baa38374a62+12:15895:x1876028947570432:12345-192.168.202.32@tcp:37:lfs.0 Request processed in 18235us (18412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121160.247384:0:17857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 3 00000100:00100000:3.0:1789121160.255118:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.256959:0:17858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947570688 00000100:00100000:0.0:1789121160.256979:0:17858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947570688 00000100:00100000:0.0:1789121160.257079:0:17858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:0.0:1789121160.257093:0:17858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94678296b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+12:15895:x1876028947570688:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789121160.257455:0:17858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94678296b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+13:15895:x1876028947570688:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 363us (2359us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789121160.257466:0:17858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 4 00000100:00100000:3.0:1789121160.314070:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121160.314260:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947570816 00000100:00100000:1.0:1789121160.314293:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947570816 00000100:00100000:1.0:1789121160.314378:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:1.0:1789121160.314390:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+11:15901:x1876028947570816:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:1.0:1789121160.314417:0:17856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121160.314446:0:17856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310b91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7eefc expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.314531:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310b98 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.314549:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310b98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.314563:0:17856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310b98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.314575:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310b9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.314584:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310b9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.314590:0:17856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310b9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.320476:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a8310ba6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.320512:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a8310ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.320530:0:17856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a8310ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121160.320631:0:17856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789121160.320636:0:17856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121160.324688:0:17856:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a8310ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.324734:0:17856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310b98 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.324744:0:17856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310b98 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.324755:0:17856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310b98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.324762:0:17856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121160.326839:0:17856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310b98 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.326873:0:17856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310b98 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.326901:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946782181e00) 00010000:00010000:2.0:1789121160.326905:0:17856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121160.326911:0:17856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310b98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.326920:0:17856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310b98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.326950:0:17856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310b9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.329432:0:17856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310b9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.329443:0:17856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310b9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.329451:0:17856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121160.329457:0:17856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310b9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.329468:0:17856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310b9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.329492:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff946888a7ff00) 00010000:00010000:2.0:1789121160.329496:0:17856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121160.329503:0:17856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310b9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.329511:0:17856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310b9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.329588:0:17856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310b91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eefc expref: 13 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.329607:0:17856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3e00/0xb74d2367a8310ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eefc expref: 12 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.329615:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:2.0:1789121160.329618:0:17856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789121160.329637:0:17856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3e00, rc 0) 00000100:00100000:2.0:1789121160.329762:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+12:15901:x1876028947570816:12345-192.168.202.32@tcp:101:bash.0 Request processed in 15372us (15703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121160.329783:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 36 00000100:00100000:2.0:1789121160.334909:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.335751:0:17866:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947570944 00000100:00100000:0.0:1789121160.335776:0:17866:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947570944 00000100:00100000:0.0:1789121160.335881:0:17866:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:0.0:1789121160.335893:0:17866:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:15901:x1876028947570944:12345-192.168.202.32@tcp:900:bash.0 00000100:00100000:0.0:1789121160.336256:0:17866:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5da40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:15901:x1876028947570944:12345-192.168.202.32@tcp:900:bash.0 Request processed in 363us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121160.336265:0:17866:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:3.0:1789121160.340712:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.341273:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947571200 00000100:00100000:2.0:1789121160.341289:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947571200 00000100:00100000:2.0:1789121160.341385:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:2.0:1789121160.341399:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+12:15901:x1876028947571200:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789121160.341429:0:19756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121160.341459:0:19756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310bad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef03 expref: -99 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.341592:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.341610:0:19756:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eef5 expref: 12 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.341620:0:19756:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.341660:0:19756:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eef5 expref: 12 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.341675:0:19756:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eef5 expref: 12 pid: 19755 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121160.341691:0:19756:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19756:1876028970729472:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789121160.341855:0:19756:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afc01600 going to sleep for 11 seconds 00000100:00100000:2.0:1789121160.354419:0:19756:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5f0c0 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:19756:1876028970729472:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789121160.354469:0:19756:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121160.354812:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.355333:0:17839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947571328 00000100:00100000:0.0:1789121160.355349:0:17839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947571328 00010000:00010000:0.0:1789121160.355400:0:17839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eef5 expref: 13 pid: 19755 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121160.355477:0:17839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 16 00000100:00100000:0.0:1789121160.355488:0:17839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d1c643e-f8d1-4998-bc1e-8baa38374a62+13:2411:x1876028947571328:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789121160.355511:0:17839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121160.355520:0:17839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eef5 expref: 13 pid: 19755 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.355533:0:17839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eef5 expref: 13 pid: 19755 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.355562:0:17839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310b8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7eef5 expref: 13 pid: 19755 timeout: 710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.355583:0:17839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:0.0:1789121160.355589:0:17839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.355602:0:17839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.355610:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.355649:0:17839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121160.355740:0:17839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0d1c643e-f8d1-4998-bc1e-8baa38374a62+12:2411:x1876028947571328:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 253us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121160.355751:0:17839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 16 00010000:00010000:2.0:1789121160.356008:0:19756:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356018:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356067:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356080:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356089:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356718:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310bc2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356732:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356740:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121160.356753:0:19756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789121160.356787:0:19756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356811:0:19756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356859:0:19756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356868:0:19756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121160.356874:0:19756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356884:0:19756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356898:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:2.0:1789121160.356902:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121160.356907:0:19756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356914:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bb4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789121160.356931:0:19756:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 0000000014276b87 reply state 000000002a120ee0 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356944:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.356950:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff946888a7f600) 00010000:00010000:2.0:1789121160.356953:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789121160.356957:0:19756:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789121160.357007:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310bad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef03 expref: 15 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.357035:0:19756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef03 expref: 14 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.357044:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:2.0:1789121160.357046:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789121160.357049:0:19756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991000, rc 0) 00000100:00100000:2.0:1789121160.357123:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b07840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+15:15901:x1876028947571200:12345-192.168.202.32@tcp:101:bash.0 Request processed in 15727us (16426us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789121160.357133:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 37 00000100:00100000:0.0:1789121160.381042:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.381258:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947571456 00000100:00100000:2.0:1789121160.381271:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947571456 00000100:00100000:2.0:1789121160.381363:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:2.0:1789121160.381377:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+15:15901:x1876028947571456:12345-192.168.202.32@tcp:101:bash.0 00010000:00010000:2.0:1789121160.381412:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121160.381443:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310bd0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef0a expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.381534:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.381552:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.381566:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121160.381628:0:19755:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789121160.381641:0:19755:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121160.381670:0:19755:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.381684:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.381714:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310bd0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef0a expref: 17 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.381738:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef0a expref: 16 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.381749:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:2.0:1789121160.381753:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789121160.381771:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991400, rc 0) 00000100:00100000:2.0:1789121160.381897:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+16:15901:x1876028947571456:12345-192.168.202.32@tcp:101:bash.0 Request processed in 522us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121160.381906:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 38 00000100:00100000:1.0:1789121160.388545:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.390190:0:17858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947571712 00000100:00100000:0.0:1789121160.390223:0:17858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947571712 00000100:00100000:0.0:1789121160.390304:0:17858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:0.0:1789121160.390316:0:17858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+16:15901:x1876028947571712:12345-192.168.202.32@tcp:35:bash.0 00000100:00100000:0.0:1789121160.390741:0:17858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+17:15901:x1876028947571712:12345-192.168.202.32@tcp:35:bash.0 Request processed in 425us (2210us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789121160.390751:0:17858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 5 00000100:00100000:1.0:1789121160.490094:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.492734:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947571968 00000100:00100000:2.0:1789121160.492755:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947571968 00000100:00100000:3.0:1789121160.492982:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:3.0:1789121160.492996:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+17:15911:x1876028947571968:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:3.0:1789121160.493032:0:17856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121160.493567:0:17856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310bde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef11 expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789121160.493716:0:17856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789121160.493956:0:17856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310bde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef11 expref: 19 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.493975:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff946782181e00) 00010000:00010000:3.0:1789121160.493995:0:17856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789121160.494002:0:17856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310bde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef11 expref: 19 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.494019:0:17856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d0400, rc 0) 00000100:00100000:3.0:1789121160.494230:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+18:15911:x1876028947571968:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 1236us (4151us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1789121160.494240:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 39 00000100:00100000:3.0:1789121160.501311:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121160.501500:0:17857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947572224 00000100:00100000:1.0:1789121160.501513:0:17857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947572224 00000100:00100000:1.0:1789121160.501635:0:17857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:1.0:1789121160.501647:0:17857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+18:15911:x1876028947572224:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:1.0:1789121160.502017:0:17857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+19:15911:x1876028947572224:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 371us (718us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1789121160.502026:0:17857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 6 00000100:00100000:1.0:1789121160.547143:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.547316:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947572480 00000100:00100000:2.0:1789121160.547337:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947572480 00000100:00100000:2.0:1789121160.547405:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:2.0:1789121160.547414:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+19:15914:x1876028947572480:12345-192.168.202.32@tcp:101:lfs.0 00010000:00010000:2.0:1789121160.547445:0:19756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121160.547481:0:19756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310bec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef18 expref: -99 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.547624:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310bf3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.547657:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.547670:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121160.547683:0:19756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789121160.547810:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310bec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef18 expref: 22 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.547872:0:19756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef18 expref: 21 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.547882:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:2.0:1789121160.547885:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789121160.547890:0:19756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991800, rc 0) 00000100:00100000:2.0:1789121160.547971:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+21:15914:x1876028947572480:12345-192.168.202.32@tcp:101:lfs.0 Request processed in 557us (842us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789121160.547980:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 40 00000100:00100000:2.0:1789121160.553618:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.553730:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.553874:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947572608 00000100:00100000:0.0:1789121160.553888:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947572608 00000100:00100000:0.0:1789121160.554037:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:0.0:1789121160.554050:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+21:15914:x1876028947572608:12345-192.168.202.32@tcp:54:lfs.0 00010000:00010000:0.0:1789121160.554150:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c01 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.554172:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.554188:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.554244:0:19755:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c01 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.554251:0:19755:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c01 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.554259:0:19755:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.554265:0:19755:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ac800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121160.554288:0:19755:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c01 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.554297:0:19755:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c01 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.554313:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:0.0:1789121160.554317:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00000100:00100000:1.0:1789121160.557255:0:20893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947572736 00000100:00100000:1.0:1789121160.557276:0:20893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947572736 00000100:00100000:1.0:1789121160.557514:0:20893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:1.0:1789121160.557526:0:20893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+22:2411:x1876028947572736:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789121160.557547:0:20893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121160.557581:0:20893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310bf3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef18 expref: 22 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.557608:0:20893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:1.0:1789121160.557615:0:20893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121160.557703:0:20893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+21:2411:x1876028947572736:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 180us (4099us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121160.557713:0:20893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00010000:00010000:0.0:1789121160.562837:0:19755:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c01 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.562862:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c01 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121160.563024:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+20:15914:x1876028947572608:12345-192.168.202.32@tcp:54:lfs.0 Request processed in 8968us (9284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121160.563036:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 41 00000100:00100000:2.0:1789121160.567033:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.567090:0:17858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947572992 00000100:00100000:0.0:1789121160.567104:0:17858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947572992 00000100:00100000:0.0:1789121160.567243:0:17858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 7 00000100:00100000:0.0:1789121160.567258:0:17858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+20:15914:x1876028947572992:12345-192.168.202.32@tcp:35:lfs.0 00000100:00100000:0.0:1789121160.567662:0:17858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+21:15914:x1876028947572992:12345-192.168.202.32@tcp:35:lfs.0 Request processed in 406us (644us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789121160.567672:0:17858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 7 00010000:00010000:1.0:1789121160.660715:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789121160.850621:0:18613:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789121160.866739:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121160.866853:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947573248 00000100:00100000:3.0:1789121160.866868:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947573248 00000100:00100000:3.0:1789121160.866961:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:3.0:1789121160.866977:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+21:15945:x1876028947573248:12345-192.168.202.32@tcp:101:cat.0 00010000:00010000:3.0:1789121160.867014:0:17856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789121160.867050:0:17856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310c08 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef1f expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.867216:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8310c0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.867236:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8310c0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.867256:0:17856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8310c0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789121160.867273:0:17856:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789121160.867546:0:17856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0400/0xb74d2367a8310c08 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef1f expref: 24 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.867593:0:17856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8310c0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef1f expref: 23 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121160.867603:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:3.0:1789121160.867607:0:17856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789121160.867612:0:17856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9467838d1000, rc 0) 00000100:00100000:3.0:1789121160.867703:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+23:15945:x1876028947573248:12345-192.168.202.32@tcp:101:cat.0 Request processed in 729us (982us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1789121160.867712:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 42 00000100:00100000:1.0:1789121160.876267:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121160.881070:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121160.881184:0:17857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947573632 00000100:00100000:3.0:1789121160.881209:0:17857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947573632 00000100:00100000:3.0:1789121160.881383:0:17857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:3.0:1789121160.881400:0:17857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+23:15945:x1876028947573632:12345-192.168.202.32@tcp:35:cat.0 00000100:00100000:3.0:1789121160.882106:0:17857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1bc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+24:15945:x1876028947573632:12345-192.168.202.32@tcp:35:cat.0 Request processed in 704us (1047us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789121160.882117:0:17857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 8 00000100:00100000:0.0:1789121160.884382:0:17839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947573376 00000100:00100000:0.0:1789121160.884405:0:17839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947573376 00000100:00100000:0.0:1789121160.884525:0:17839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:0.0:1789121160.884548:0:17839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+24:2411:x1876028947573376:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789121160.884574:0:17839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121160.884632:0:17839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d1000/0xb74d2367a8310c0f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef1f expref: 24 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.884660:0:17839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:0.0:1789121160.884667:0:17839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121160.884760:0:17839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d192c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+23:2411:x1876028947573376:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 224us (8512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121160.884776:0:17839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:1.0:1789121160.933610:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.933775:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947573888 00000100:00100000:0.0:1789121160.933789:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947573888 00000100:00100000:2.0:1789121160.934137:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:2.0:1789121160.934153:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+23:15951:x1876028947573888:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:2.0:1789121160.934202:0:17854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121160.934232:0:17854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c1d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef26 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.934424:0:17854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.934443:0:17854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310bc2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef03 expref: 24 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.934452:0:17854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef0a expref: 24 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.934462:0:17854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.934509:0:17854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef0a expref: 24 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.934526:0:17854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef0a expref: 24 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121160.934543:0:17854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17854:1876028970729600:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789121160.934677:0:17854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef03 expref: 24 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.934688:0:17854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef03 expref: 24 pid: 19756 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121160.934698:0:17854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17854:1876028970729728:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789121160.934735:0:17854:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afc01540 going to sleep for 11 seconds 00000100:00100000:0.0:1789121160.938130:0:17854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5ed00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17854:1876028970729600:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789121160.938155:0:17854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5c3c0 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:17854:1876028970729728:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789121160.938233:0:17854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121160.939691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121160.939749:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.939896:0:20893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947574016 00000100:00100000:2.0:1789121160.939908:0:20893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947574016 00010000:00010000:2.0:1789121160.939981:0:20893:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef0a expref: 25 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121160.940032:0:20893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947574144 00000100:00100000:2.0:1789121160.940035:0:20893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947574144 00010000:00010000:2.0:1789121160.940051:0:20893:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef03 expref: 26 pid: 19756 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121160.940081:0:20893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:2.0:1789121160.940093:0:20893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+26:2412:x1876028947574016:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789121160.940114:0:20893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121160.940122:0:20893:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef0a expref: 26 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.940136:0:20893:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef0a expref: 26 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.940165:0:20893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310bd7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef0a expref: 26 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.940197:0:20893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:2.0:1789121160.940203:0:20893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.940212:0:20893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.940237:0:20893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121160.940306:0:20893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+25:2412:x1876028947574016:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 214us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121160.940314:0:20893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 17 00000100:00100000:2.0:1789121160.940360:0:20893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 18 00000100:00100000:2.0:1789121160.940367:0:20893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467839f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+24:2412:x1876028947574144:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789121160.940375:0:20893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121160.940380:0:20893:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310bc2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef03 expref: 24 pid: 19756 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.940391:0:20893:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef03 expref: 24 pid: 19756 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.940405:0:20893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310bc2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef03 expref: 24 pid: 19756 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.940416:0:20893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:2.0:1789121160.940420:0:20893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.940429:0:20893:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.940438:0:20893:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.940467:0:20893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789121160.940494:0:20893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467839f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+23:2412:x1876028947574144:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 127us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121160.940502:0:20893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 18 00010000:00010000:0.0:1789121160.940694:0:17854:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.940705:0:17854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789121160.940730:0:17854:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789121160.941007:0:17854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c1d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef26 expref: 24 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.941025:0:17854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991600/0xb74d2367a8310c24 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef26 expref: 23 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.941033:0:17854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:0.0:1789121160.941043:0:17854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789121160.941047:0:17854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991600, rc 0) 00000100:00100000:0.0:1789121160.941077:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d183c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+23:15951:x1876028947573888:12345-192.168.202.32@tcp:101:dd.0 Request processed in 6929us (7483us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1789121160.941085:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 43 00000100:00100000:2.0:1789121160.943902:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.944157:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947574272 00000100:00100000:0.0:1789121160.944172:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947574272 00000100:00100000:0.0:1789121160.944268:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:0.0:1789121160.944281:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+23:15951:x1876028947574272:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:0.0:1789121160.944318:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121160.944360:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c32 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef2d expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.944411:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8310c39 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.944428:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8310c39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.944441:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8310c39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.944600:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef2d expref: 25 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.944624:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8310c39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef2d expref: 24 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.944635:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:0.0:1789121160.944645:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789121160.944650:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ac200, rc 0) 00000100:00100000:0.0:1789121160.944739:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5f0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+24:15951:x1876028947574272:12345-192.168.202.32@tcp:101:dd.0 Request processed in 460us (852us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121160.944749:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 44 00000100:00100000:3.0:1789121160.949476:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.949593:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947574528 00000100:00100000:0.0:1789121160.949607:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947574528 00000100:00100000:0.0:1789121160.949697:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 45 00000100:00100000:0.0:1789121160.949710:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+24:15951:x1876028947574528:12345-192.168.202.32@tcp:36:dd.0 00010000:00010000:0.0:1789121160.950115:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.950143:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.950158:0:17856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789121160.950252:0:17856:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1789121160.950282:0:17856:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 000000001e9082df reply state 00000000d6cbb922 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.950299:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.950309:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:0.0:1789121160.950312:0:17856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789121160.950317:0:17856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789121160.950436:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+27:15951:x1876028947574528:12345-192.168.202.32@tcp:36:dd.0 Request processed in 727us (977us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1789121160.950445:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 45 00000020:00080000:0.0:1789121160.950471:0:17856:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789121160.955467:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121160.955696:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947574656 00000100:00100000:0.0:1789121160.955710:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947574656 00000100:00100000:0.0:1789121160.956011:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:0.0:1789121160.956027:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+27:15951:x1876028947574656:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:0.0:1789121160.956068:0:17854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121160.956111:0:17854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ada00/0xb74d2367a8310c47 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef34 expref: -99 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.956247:0:17854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ada00/0xb74d2367a8310c47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef34 expref: 28 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.956266:0:17854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ada00/0xb74d2367a8310c47 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef34 expref: 28 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121160.956292:0:17854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:0.0:1789121160.956296:0:17854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789121160.956300:0:17854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ada00, rc 0) 00000100:00100000:0.0:1789121160.956555:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+28:15951:x1876028947574656:12345-192.168.202.32@tcp:101:dd.0 Request processed in 529us (1102us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121160.956563:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 46 00000100:00100000:2.0:1789121160.972500:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121160.972679:0:20893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947574912 00000100:00100000:1.0:1789121160.972716:0:20893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947574912 00000100:00100000:1.0:1789121160.972809:0:20893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:1.0:1789121160.972873:0:20893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+28:15951:x1876028947574912:12345-192.168.202.32@tcp:103:dd.0 00010000:00010000:1.0:1789121160.972897:0:20893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121160.972941:0:20893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ada00/0xb74d2367a8310c47 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef34 expref: 28 pid: 17854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121160.972966:0:20893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:1.0:1789121160.972973:0:20893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121160.973055:0:20893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5cb40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+27:15951:x1876028947574912:12345-192.168.202.32@tcp:103:dd.0 Request processed in 235us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121160.973063:0:20893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 2 00000100:00100000:3.0:1789121160.976322:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.976666:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947575040 00000100:00100000:2.0:1789121160.976678:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947575040 00000100:00100000:2.0:1789121160.976860:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:2.0:1789121160.976876:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+27:15951:x1876028947575040:12345-192.168.202.32@tcp:58:dd.0 00010000:00010000:2.0:1789121160.977078:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.977439:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.977460:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789121160.979486:0:19756:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789121160.980087:0:19756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789121160.980533:0:19756:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789121160.980845:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b052c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+27:15951:x1876028947575040:12345-192.168.202.32@tcp:58:dd.0 Request processed in 3944us (4508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121160.980860:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 47 00000100:00100000:1.0:1789121160.986062:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121160.986247:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947575168 00000100:00100000:2.0:1789121160.986262:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947575168 00000100:00100000:2.0:1789121160.986449:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 48 00000100:00100000:2.0:1789121160.986464:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+27:15951:x1876028947575168:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:2.0:1789121160.986493:0:17855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121160.986556:0:17855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310c55 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef3b expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.986639:0:17855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.986652:0:17855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310c55 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef3b expref: 28 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.986679:0:17855:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.986697:0:17855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310c55 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef3b expref: 28 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.986714:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:2.0:1789121160.986718:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789121160.986723:0:17855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310c55 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef3b expref: 28 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121160.986732:0:17855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991400, rc 0) 00000100:00100000:2.0:1789121160.987071:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18b40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+28:15951:x1876028947575168:12345-192.168.202.32@tcp:101:dd.0 Request processed in 610us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121160.987081:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 48 00000040:00080000:0.0:1789121161.170042:0:17891:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789121161.170059:0:17891:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789121161.170098:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789121161.170109:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789121161.170346:0:17891:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c383c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17891:1876028970729856:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789121161.170496:0:17891:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783095b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789121161.177105:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121161.177523:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947575296 00000100:00100000:2.0:1789121161.177536:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947575296 00000100:00100000:2.0:1789121161.177638:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00100000:2.0:1789121161.177653:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+29:15952:x1876028947575296:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789121161.177703:0:17854:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789121161.177926:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+29:15952:x1876028947575296:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 276us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121161.177935:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 49 00000100:00080000:3.0:1789121161.178233:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789121161.178680:0:17891:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c383c0 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17891:1876028970729856:192.168.202.32@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789121161.187260:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121161.187885:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947575424 00000100:00100000:2.0:1789121161.187901:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947575424 00000100:00100000:2.0:1789121161.188023:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:2.0:1789121161.188038:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+28:15952:x1876028947575424:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789121161.188172:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310c5c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188209:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310c5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188227:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310c5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188249:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c63 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188258:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188265:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188301:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c6a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188311:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188318:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121161.188434:0:19756:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789121161.188441:0:19756:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789121161.188461:0:19756:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188476:0:19756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310c5c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188483:0:19756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310c5c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188492:0:19756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310c5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188500:0:19756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121161.188506:0:19756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310c5c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188516:0:19756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310c5c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188534:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9468b9862d00) 00010000:00010000:2.0:1789121161.188538:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121161.188544:0:19756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310c5c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188551:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310c5c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188570:0:19756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c63 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188588:0:19756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c63 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188594:0:19756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188600:0:19756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121161.188604:0:19756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c63 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188610:0:19756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c63 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188619:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff946888a7fb00) 00010000:00010000:2.0:1789121161.188622:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121161.188625:0:19756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c63 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188632:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c63 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188656:0:19756:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c6a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188664:0:19756:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c6a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188671:0:19756:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188676:0:19756:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121161.188686:0:19756:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c6a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188693:0:19756:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c6a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188702:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:2.0:1789121161.188705:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121161.188708:0:19756:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c6a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.188715:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c6a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121161.188908:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1a940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+28:15952:x1876028947575424:12345-192.168.202.32@tcp:34:lhsmtool_posix.0 Request processed in 871us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121161.188917:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 50 00000100:00100000:3.0:1789121161.194712:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121161.195135:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947575680 00000100:00100000:2.0:1789121161.195150:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947575680 00000100:00100000:2.0:1789121161.195257:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:2.0:1789121161.195271:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+28:15952:x1876028947575680:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789121161.195302:0:17855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121161.195404:0:17855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef42 expref: -99 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.195569:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c78 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.195593:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.195633:0:17855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789121161.195649:0:17855:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789121161.195771:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c78 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.195779:0:17855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c78 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.195786:0:17855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.195794:0:17855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121161.195799:0:17855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c78 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.195808:0:17855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c78 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.195861:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:2.0:1789121161.195864:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789121161.195872:0:17855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c78 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.195879:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310c78 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.196470:0:17855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c71 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef42 expref: 30 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.196505:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9468b9862d00) 00010000:00010000:2.0:1789121161.196508:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789121161.196513:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef42 expref: 30 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.196526:0:17855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa990c00, rc 0) 00000100:00100000:2.0:1789121161.196676:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b05680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+29:15952:x1876028947575680:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1407us (1979us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1789121161.196687:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 51 00000100:00100000:1.0:1789121161.202305:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121161.202463:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947575808 00000100:00100000:0.0:1789121161.202476:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947575808 00000100:00100000:0.0:1789121161.202560:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:0.0:1789121161.202574:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+29:15952:x1876028947575808:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789121161.202627:0:17856:0:(mdt_handler.c:7985:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789121161.202925:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d19680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+29:15952:x1876028947575808:12345-192.168.202.32@tcp:53:lhsmtool_posix.0 Request processed in 347us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121161.202935:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 52 00000100:00100000:1.0:1789121161.232805:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121161.234409:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947576064 00000100:00100000:0.0:1789121161.234431:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947576064 00000100:00100000:0.0:1789121161.234610:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:0.0:1789121161.234625:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+29:15952:x1876028947576064:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789121161.234661:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121161.234697:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c86 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef49 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789121161.235384:0:19755:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x7:0x0], count =27 00000004:00080000:0.0:1789121161.235394:0:19755:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789121161.235414:0:19755:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1789121161.235620:0:19755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad800/0xb74d2367a8310c8d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.235639:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad800/0xb74d2367a8310c8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.235653:0:19755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad800/0xb74d2367a8310c8d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19755 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.235743:0:19755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310c86 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef49 expref: 32 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.235767:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad800/0xb74d2367a8310c8d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef49 expref: 31 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.235777:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9468b9862a00) 00010000:00010000:0.0:1789121161.235780:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789121161.235785:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ad800, rc 0) 00000100:00100000:0.0:1789121161.235947:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d19e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+31:15952:x1876028947576064:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1326us (3158us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789121161.235958:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 53 00000100:00100000:3.0:1789121161.240243:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121161.240539:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947576320 00000100:00100000:2.0:1789121161.240553:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947576320 00000100:00100000:2.0:1789121161.240642:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:2.0:1789121161.240655:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+31:15952:x1876028947576320:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789121161.240775:0:17855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789121161.240815:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ad800/0xb74d2367a8310c8d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef49 expref: 31 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.240872:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9468b9862a00) 00010000:00010000:2.0:1789121161.240886:0:17855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789121161.241022:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c9b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241044:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c9b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241058:0:17855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c9b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241091:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ca2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5a99c10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241099:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5a99c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241107:0:17855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5a99c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241182:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c9b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241209:0:17855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c9b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241217:0:17855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c9b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241225:0:17855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121161.241231:0:17855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c9b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241240:0:17855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c9b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241250:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:2.0:1789121161.241253:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121161.241258:0:17855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c9b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241265:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990c00/0xb74d2367a8310c9b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241287:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ca2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5a99c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241294:0:17855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ca2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5a99c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241301:0:17855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5a99c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241307:0:17855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:2.0:1789121161.241311:0:17855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ca2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5a99c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241317:0:17855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ca2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5a99c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241326:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc5a99c10 (ffff946888a7fb00) 00010000:00010000:2.0:1789121161.241329:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789121161.241626:0:17855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ca2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5a99c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.241635:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991800/0xb74d2367a8310ca2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5a99c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121161.241798:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+30:15952:x1876028947576320:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 1142us (1574us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789121161.241808:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 54 00000100:00100000:1.0:1789121161.246809:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121161.247295:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947576448 00000100:00100000:2.0:1789121161.247309:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947576448 00000100:00100000:2.0:1789121161.247429:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:2.0:1789121161.247462:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+30:15952:x1876028947576448:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789121161.247493:0:19756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121161.247524:0:19756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310ca9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef50 expref: -99 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.247576:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a8310cb0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.247593:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a8310cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.247607:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a8310cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.247759:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991c00/0xb74d2367a8310ca9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef50 expref: 32 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.247781:0:19756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468c217d600/0xb74d2367a8310cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef50 expref: 31 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.247790:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00010000:00010000:2.0:1789121161.247792:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789121161.247797:0:19756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217d600, rc 0) 00000100:00100000:2.0:1789121161.247914:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1ad00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+31:15952:x1876028947576448:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 455us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121161.248388:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 55 00000100:00100000:3.0:1789121161.253760:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121161.260758:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947576704 00000100:00100000:0.0:1789121161.260780:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947576704 00000100:00100000:0.0:1789121161.260959:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:0.0:1789121161.260973:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+31:15952:x1876028947576704:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789121161.261100:0:17854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.261126:0:17854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.261141:0:17854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789121161.261437:0:17854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789121161.261453:0:17854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 611450630951ns, next at 612450627301ns, rc = 0 00000004:00010000:0.0:1789121161.261561:0:17854:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000913ccc02 reply state 00000000fe685e0c transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.261579:0:17854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.261589:0:17854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00010000:00010000:0.0:1789121161.261592:0:17854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1789121161.261598:0:17854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789121161.261768:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d21c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+33:15952:x1876028947576704:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 796us (8022us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789121161.261777:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 56 00000100:00100000:1.0:1789121161.264254:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121161.264532:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947576832 00000100:00100000:0.0:1789121161.264545:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947576832 00000100:00100000:0.0:1789121161.264629:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:0.0:1789121161.264643:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+33:15952:x1876028947576832:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789121161.264676:0:19755:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789121161.264706:0:19755:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8310cbe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef57 expref: -99 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.264786:0:19755:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8310cbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef57 expref: 34 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.264802:0:19755:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8310cbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef57 expref: 34 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.265011:0:19755:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00010000:00010000:0.0:1789121161.265146:0:19755:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789121161.265167:0:19755:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa9ace00, rc 0) 00000100:00100000:1.0:1789121161.265658:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+34:15952:x1876028947576832:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 1012us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121161.265668:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 57 00000100:00100000:1.0:1789121161.275479:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121161.276247:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947576960 00000100:00100000:0.0:1789121161.276263:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947576960 00000100:00100000:0.0:1789121161.276463:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00100000:0.0:1789121161.276480:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2412:x1876028947576960:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789121161.276882:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d18780 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2412:x1876028947576960:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 406us (1417us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789121161.276893:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 23 00000100:00080000:3.0:1789121161.277432:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121161.284875:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121161.289276:0:17858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947577216 00000100:00100000:1.0:1789121161.289298:0:17858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947577216 00000100:00100000:1.0:1789121161.289418:0:17858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:1.0:1789121161.289433:0:17858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+34:15952:x1876028947577216:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789121161.289873:0:17858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+35:15952:x1876028947577216:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 440us (5067us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789121161.289883:0:17858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 9 00000100:00100000:2.0:1789121161.295892:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121161.296252:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947577472 00000100:00100000:3.0:1789121161.296267:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947577472 00000100:00100000:3.0:1789121161.296378:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:3.0:1789121161.296391:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+35:15952:x1876028947577472:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789121161.296575:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+35:15952:x1876028947577472:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 186us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121161.296585:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 58 00000100:00100000:2.0:1789121161.299722:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121161.301045:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947577600 00000100:00100000:1.0:1789121161.301066:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947577600 00000100:00100000:1.0:1789121161.301177:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:1.0:1789121161.301205:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+35:15952:x1876028947577600:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789121161.301239:0:17856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121161.301271:0:17856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8310cc5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef5e expref: -99 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.301511:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310ccc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.301533:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310ccc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.301548:0:17856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310ccc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789121161.301624:0:17856:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789121161.301656:0:17856:0:(mdt_handler.c:2515:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310ccc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.301691:0:17856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2000/0xb74d2367a8310cc5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef5e expref: 37 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.301716:0:17856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310ccc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef5e expref: 36 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.303151:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00010000:00010000:1.0:1789121161.303157:0:17856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789121161.303162:0:17856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3000, rc 0) 00000100:00100000:1.0:1789121161.303443:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+36:15952:x1876028947577600:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 2235us (3732us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121161.303455:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 59 00000100:00100000:0.0:1789121161.315956:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121161.316198:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947577728 00000100:00100000:2.0:1789121161.316213:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947577728 00000100:00100000:2.0:1789121161.316313:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:2.0:1789121161.316328:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2412:x1876028947577728:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789121161.316371:0:19367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121161.316413:0:19367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310cd3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef65 expref: -99 pid: 19367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789121161.316454:0:19367:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa3d288, blocks: 0x0 00010000:00010000:2.0:1789121161.316487:0:19367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=611s v=(0 0) 00010000:00010000:2.0:1789121161.316492:0:19367:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121161.316505:0:19367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310cd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef65 expref: 7 pid: 19367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.316529:0:19367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310cd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef65 expref: 7 pid: 19367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.316544:0:19367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468c217c000, rc 0) 00000100:00100000:2.0:1789121161.316633:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c383c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:2412:x1876028947577728:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 308us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121161.316642:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 24 00000100:00100000:2.0:1789121161.320319:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121161.320427:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947577984 00000100:00100000:1.0:1789121161.320439:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947577984 00000100:00100000:1.0:1789121161.320519:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:1.0:1789121161.320532:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+36:15952:x1876028947577984:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789121161.320690:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5e940 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+36:15952:x1876028947577984:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 161us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121161.320699:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 60 00000100:00100000:1.0:1789121161.336260:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121161.336398:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947578112 00000100:00100000:2.0:1789121161.336414:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947578112 00000100:00100000:2.0:1789121161.336566:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 61 00000100:00100000:2.0:1789121161.336583:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+36:15952:x1876028947578112:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789121161.342087:0:17834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1789121161.342121:0:17834:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1789121161.342227:0:17834:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1789121161.342638:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1b0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+19:15952:x1876028947578112:12345-192.168.202.32@tcp:44:lhsmtool_posix.0 Request processed in 6050us (6387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121161.342654:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 61 00010000:00010000:0.0:1789121161.343343:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.343360:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.343368:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.343376:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a2c00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:0.0:1789121161.343382:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.343391:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.343414:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:0.0:1789121161.343418:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1789121161.343425:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.343432:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a2c00/0xb74d2367a8310b60 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121161.343511:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789121161.343537:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970729984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789121161.343627:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121161.345566:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970729984 00000100:00100000:2.0:1789121161.345583:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970729984 00000100:00100000:2.0:1789121161.345669:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789121161.345681:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970729984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1789121161.345916:0:19368:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1789121161.345920:0:19368:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1789121161.345923:0:19368:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789121161.345925:0:19368:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789121160 -> 1789121160 00002000:00010000:2.0:1789121161.345928:0:19368:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1789121161.346020:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3645:x1876028970729984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 340us (2391us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789121161.346028:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000004:00080000:0.0:1789121161.346270:0:3645:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff946783d5c3c0/2, rc 0, transno 8589934596 00000100:00100000:0.0:1789121161.346279:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d5c3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970729984:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1789121161.347541:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347560:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347570:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347578:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121161.347584:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347594:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347614:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff946888a7ff00) 00010000:00010000:3.0:1789121161.347619:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121161.347625:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347632:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310b0c lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347661:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347687:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347694:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347699:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991e00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121161.347702:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347709:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347719:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff946888a7f200) 00010000:00010000:3.0:1789121161.347722:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121161.347725:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347732:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991e00/0xb74d2367a8310b13 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347761:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347769:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347775:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347781:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121161.347792:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347799:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347839:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff946888a7f600) 00010000:00010000:3.0:1789121161.347843:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121161.347847:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347853:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991a00/0xb74d2367a8310bbb lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347872:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347879:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347886:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347892:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9adc00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121161.347895:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347902:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347911:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:3.0:1789121161.347914:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789121161.347925:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347931:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9adc00/0xb74d2367a8310c40 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347945:0:3630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347952:0:3630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347957:0:3630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347963:0:3630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9ac800 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121161.347965:0:3630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347972:0:3630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347981:0:3630:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00010000:00010000:3.0:1789121161.347983:0:3630:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789121161.347986:0:3630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.347991:0:3630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac800/0xb74d2367a8310cb7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121161.348343:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121161.348574:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947578240 00000100:00100000:3.0:1789121161.348584:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947578240 00000100:00100000:3.0:1789121161.348652:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:3.0:1789121161.348674:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:2411:x1876028947578240:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789121161.348968:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c3a1c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:2411:x1876028947578240:12345-192.168.202.32@tcp:16:lhsmtool_posix.0 Request processed in 296us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121161.348977:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 26 00000100:00100000:2.0:1789121161.371402:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121161.371529:0:17856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947578496 00000100:00100000:1.0:1789121161.371544:0:17856:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947578496 00000100:00100000:1.0:1789121161.371644:0:17856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:1.0:1789121161.371658:0:17856:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+15:15952:x1876028947578496:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789121161.371739:0:17856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121161.371790:0:17856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310ccc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef5e expref: 15 pid: 17856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.372019:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00010000:00010000:1.0:1789121161.372026:0:17856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789121161.372071:0:17856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.372089:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.372102:0:17856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789121161.372288:0:17856:0:(mdt_handler.c:4497:mdt_save_lock()) ### save lock request 00000000bccdf8ee reply state 00000000d823f567 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.372304:0:17856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3c00/0xb74d2367a8310cda lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.372311:0:17856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00010000:00010000:1.0:1789121161.372314:0:17856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789121161.372318:0:17856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789121161.372451:0:17856:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+16:15952:x1876028947578496:12345-192.168.202.32@tcp:36:lhsmtool_posix.0 Request processed in 794us (1063us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1789121161.372459:0:17856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 62 00000100:00100000:1.0:1789121161.374691:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121161.374777:0:19368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947578624 00000100:00100000:2.0:1789121161.374791:0:19368:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947578624 00000100:00100000:2.0:1789121161.374895:0:19368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:2.0:1789121161.374907:0:19368:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:15952:x1876028947578624:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789121161.374930:0:19368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789121161.374955:0:19368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef6c expref: -99 pid: 19368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.374994:0:19368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310cd3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef65 expref: 8 pid: 19367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.375031:0:19368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121161.375037:0:19368:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121161.375044:0:19368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 8 pid: 19368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.375092:0:19368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310cd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef65 expref: 8 pid: 19367 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.375108:0:19368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310cd3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef65 expref: 8 pid: 19367 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121161.375125:0:19368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf707840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:19368:1876028970730112:192.168.202.32@tcp:104: 00000100:00100000:2.0:1789121161.375273:0:19368:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afc016c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121161.379043:0:19368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf707840 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:19368:1876028970730112:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789121161.379097:0:19368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 8 pid: 19368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.379126:0:19368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468aa991800, rc 0) 00000100:00100000:2.0:1789121161.379216:0:19368:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d19a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+8:15952:x1876028947578624:12345-192.168.202.32@tcp:101:lhsmtool_posix.0 Request processed in 4310us (4537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121161.379227:0:19368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 27 00000100:00100000:3.0:1789121161.379483:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121161.379930:0:17840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947578752 00000100:00100000:0.0:1789121161.379941:0:17840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947578752 00010000:00010000:0.0:1789121161.379991:0:17840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310cd3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef65 expref: 8 pid: 19367 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121161.380036:0:17840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:0.0:1789121161.380048:0:17840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+8:2412:x1876028947578752:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789121161.380065:0:17840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789121161.380091:0:17840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310cd3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef65 expref: 8 pid: 19367 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.380107:0:17840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310cd3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef65 expref: 8 pid: 19367 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.380139:0:17840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ef38544/0xb74d2367a8310cd3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef65 expref: 8 pid: 19367 timeout: 711 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.380162:0:17840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121161.380193:0:17840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121161.380202:0:17840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 7 pid: 19368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.380215:0:17840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 7 pid: 19368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.380262:0:17840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 7 pid: 19368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121161.380280:0:17840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c39a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17840:1876028970730240:192.168.202.32@tcp:105: 00000100:00100000:0.0:1789121161.380367:0:17840:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783118300 going to sleep for 11 seconds 00000100:00100000:0.0:1789121161.385984:0:17840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c39a40 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:17840:1876028970730240:192.168.202.32@tcp:105: 00010000:00010000:0.0:1789121161.386021:0:17840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789121161.386103:0:17840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:2412:x1876028947578752:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 6055us (6619us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121161.386118:0:17840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 19 00000100:00100000:3.0:1789121161.386351:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121161.386475:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947578880 00000100:00100000:0.0:1789121161.386484:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947578880 00000100:00100000:0.0:1789121161.386546:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:0.0:1789121161.386557:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:2411:x1876028947578880:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789121161.386801:0:19367:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789121161.386806:0:19367:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1789121160 00002000:00010000:0.0:1789121161.386809:0:19367:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1789121159 00002000:00010000:0.0:1789121161.386812:0:19367:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789121160 -> 1789121160 00002000:00010000:0.0:1789121161.386815:0:19367:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789121161.386918:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+8:2411:x1876028947578880:12345-192.168.202.32@tcp:2:lhsmtool_posix.0 Request processed in 363us (570us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789121161.386927:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:2.0:1789121161.389138:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121161.389588:0:19366:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947579008 00000100:00100000:0.0:1789121161.389600:0:19366:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947579008 00000100:00100000:0.0:1789121161.389683:0:19366:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:0.0:1789121161.389698:0:19366:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf707840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+8:2410:x1876028947579008:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789121161.389772:0:19366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.389799:0:19366:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 8 pid: 19368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.389808:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789121161.389813:0:19366:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789121161.389843:0:19366:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.389896:0:19366:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 8 pid: 19368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.389913:0:19366:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 8 pid: 19368 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789121161.389933:0:19366:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b9c39a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19366:1876028970730368:192.168.202.32@tcp:104: 00000100:00100000:0.0:1789121161.390055:0:19366:0:(client.c:2715:ptlrpc_set_wait()) set ffff946783118300 going to sleep for 11 seconds 00000100:00100000:0.0:1789121161.393078:0:19366:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b9c39a40 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:19366:1876028970730368:192.168.202.32@tcp:104: 00010000:00010000:0.0:1789121161.393119:0:19366:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121161.394204:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121161.394525:0:20893:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947579136 00000100:00100000:1.0:1789121161.394536:0:20893:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947579136 00010000:00010000:1.0:1789121161.394591:0:20893:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 9 pid: 19368 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121161.394664:0:20893:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 20 00000100:00100000:1.0:1789121161.394689:0:20893:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+9:2411:x1876028947579136:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789121161.394713:0:20893:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121161.394747:0:20893:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 9 pid: 19368 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.394766:0:20893:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 9 pid: 19368 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.394802:0:20893:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005244e31a/0xb74d2367a8310ce1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef6c expref: 9 pid: 19368 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.395104:0:20893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789121161.395110:0:20893:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789121161.395117:0:20893:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.395130:0:20893:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.395176:0:20893:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789121161.395262:0:20893:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468914dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7f977f21-a57c-43c4-b0be-1d901bfa40b7+8:2411:x1876028947579136:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 586us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121161.395272:0:20893:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 20 00010000:00010000:2.0:1789121161.395587:0:19366:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.395600:0:19366:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.395629:0:19366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.395639:0:19366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.395648:0:19366:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.395656:0:19366:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa9adc00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121161.395661:0:19366:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.395684:0:19366:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.395700:0:19366:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.395710:0:19366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebc7289f/0xb74d2367a8310ce8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19366 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121161.395858:0:19366:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf707840 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+7:2410:x1876028947579008:12345-192.168.202.32@tcp:1:lhsmtool_posix.0 Request processed in 6161us (6732us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121161.395870:0:19366:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:2.0:1789121161.400218:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121161.400384:0:17855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947579392 00000100:00100000:3.0:1789121161.400398:0:17855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947579392 00000100:00100000:3.0:1789121161.400484:0:17855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 63 00000100:00100000:3.0:1789121161.400498:0:17855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946889570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+16:15952:x1876028947579392:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789121161.400625:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.400648:0:17855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8310c39 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef2d expref: 16 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.400660:0:17855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.400727:0:17855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8310c39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef2d expref: 16 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.400759:0:17855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8310c39 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef2d expref: 16 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121161.400779:0:17855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17855:1876028970730496:192.168.202.32@tcp:104: 00000100:00100000:3.0:1789121161.401278:0:17855:0:(client.c:2715:ptlrpc_set_wait()) set ffff946885583000 going to sleep for 11 seconds 00000100:00100000:2.0:1789121161.409911:0:17855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468b99d0f00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17855:1876028970730496:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789121161.409957:0:17855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121161.412988:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121161.413445:0:17841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947579520 00000100:00100000:1.0:1789121161.413588:0:17841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947579520 00010000:00010000:1.0:1789121161.413649:0:17841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8310c39 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef2d expref: 17 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121161.413809:0:17841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:1.0:1789121161.413910:0:17841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+17:2412:x1876028947579520:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789121161.413936:0:17841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121161.413946:0:17841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8310c39 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef2d expref: 17 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.413963:0:17841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8310c39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef2d expref: 17 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.413992:0:17841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ac200/0xb74d2367a8310c39 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef2d expref: 17 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.414012:0:17841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:1.0:1789121161.414019:0:17841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310c55 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef3b expref: 16 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.414031:0:17841:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.414039:0:17841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.414047:0:17841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.414177:0:17841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789121161.414355:0:17855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.414364:0:17855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.414629:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.414643:0:17855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8310cbe lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef57 expref: 17 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.414652:0:17855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.414683:0:17855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8310cbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef57 expref: 17 pid: 19755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.414699:0:17855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8310cbe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef57 expref: 17 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121161.414722:0:17855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784893840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17855:1876028970730624:192.168.202.32@tcp:104: 00000100:00100000:1.0:1789121161.414806:0:17841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784890f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7f977f21-a57c-43c4-b0be-1d901bfa40b7+17:2412:x1876028947579520:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 985us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121161.414816:0:17841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 21 00000100:00100000:2.0:1789121161.415629:0:17855:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afc01cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789121161.419976:0:17855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784893840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17855:1876028970730624:192.168.202.32@tcp:104: 00010000:00010000:2.0:1789121161.420016:0:17855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789121161.420191:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121161.420257:0:17839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947579648 00000100:00100000:1.0:1789121161.420266:0:17839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947579648 00010000:00010000:1.0:1789121161.420319:0:17839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8310cbe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef57 expref: 17 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121161.420376:0:17839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:1.0:1789121161.420388:0:17839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+17:2411:x1876028947579648:12345-192.168.202.32@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789121161.420412:0:17839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789121161.420422:0:17839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8310cbe lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef57 expref: 17 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.420437:0:17839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8310cbe lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef57 expref: 17 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.420490:0:17839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa9ace00/0xb74d2367a8310cbe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef57 expref: 17 pid: 19755 timeout: 711 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.420510:0:17839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00010000:00010000:1.0:1789121161.420516:0:17839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.420528:0:17839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.420559:0:17839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.420587:0:17839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789121161.420698:0:17855:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.420707:0:17855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789121161.420908:0:17855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789121161.421076:0:17855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789121161.421132:0:17855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789121161.421245:0:17855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784893840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17855:1876028970730752:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789121161.421313:0:17855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121161.421354:0:17855:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afc010c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789121161.423109:0:17839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b99d0f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+19:2411:x1876028947579648:12345-192.168.202.32@tcp:103:ldlm_bl.0 Request processed in 2699us (3273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121161.423129:0:17839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 22 00000100:00100000:1.0:1789121161.424864:0:17860:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970730752 00000100:00100000:1.0:1789121161.424884:0:17860:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970730752 00000100:00100000:1.0:1789121161.424972:0:17860:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789121161.424984:0:17860:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17855:x1876028970730752:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789121161.425179:0:17860:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848903c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17855:x1876028970730752:12345-0@lo:1000:mdt00_001.0 Request processed in 197us (3864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121161.425197:0:17860:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789121161.428026:0:17855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784893840 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17855:1876028970730752:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1789121161.428635:0:17855:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1789121161.428742:0:17855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17855:1876028970730880:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1789121161.428865:0:17855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121161.428910:0:17855:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468835f8840 going to sleep for 11 seconds 00000100:00100000:0.0:1789121161.429057:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970730880 00000100:00100000:0.0:1789121161.429069:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970730880 00000100:00100000:0.0:1789121161.429213:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789121161.429225:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17855:x1876028970730880:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789121161.429631:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2e1c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:17855:x1876028970730880:12345-0@lo:1000:mdt00_001.0 Request processed in 408us (767us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789121161.429640:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789121161.429746:0:17855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2d2c0 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:17855:1876028970730880:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1789121161.429798:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.429810:0:17855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.429925:0:17855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.429933:0:17855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990400 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121161.429939:0:17855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.429947:0:17855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.429967:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00010000:00010000:3.0:1789121161.429971:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789121161.429977:0:17855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.429984:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa990400/0xb74d2367a8310cf6 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.430048:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.430055:0:17855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.430062:0:17855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.430068:0:17855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa991000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:3.0:1789121161.430071:0:17855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.430077:0:17855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.430086:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:3.0:1789121161.430178:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789121161.430195:0:17855:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310c55 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef3b expref: 19 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.430210:0:17855:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310c55 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef3b expref: 19 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789121161.430219:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310c55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef3b expref: 19 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.430433:0:17855:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991400/0xb74d2367a8310c55 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef3b expref: 19 pid: 17855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121161.430448:0:17855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17855:1876028970731008:192.168.202.32@tcp:105: 00000100:00100000:2.0:1789121161.430633:0:17855:0:(client.c:2715:ptlrpc_set_wait()) set ffff9468afc01f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789121161.433848:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121161.433889:0:17858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947579776 00000100:00100000:3.0:1789121161.433920:0:17858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947579776 00000100:00100000:3.0:1789121161.433985:0:17858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:3.0:1789121161.433996:0:17858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946782969850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+20:15951:x1876028947579776:12345-192.168.202.32@tcp:49:dd.0 00000100:00100000:3.0:1789121161.434191:0:17858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946782969850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+20:15951:x1876028947579776:12345-192.168.202.32@tcp:49:dd.0 Request processed in 186us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121161.434201:0:17858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 10 00000100:00100000:1.0:1789121161.435078:0:17855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892940 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17855:1876028970731008:192.168.202.32@tcp:105: 00010000:00010000:1.0:1789121161.435124:0:17855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435137:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468aa991000/0xb74d2367a8310c4e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435192:0:17855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310cfd lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435209:0:17855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310cfd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435222:0:17855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310cfd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435247:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310cfd lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435254:0:17855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310cfd lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435260:0:17855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310cfd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435267:0:17855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3000 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789121161.435271:0:17855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310cfd lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435279:0:17855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310cfd lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435296:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:1.0:1789121161.435299:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789121161.435303:0:17855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310cfd lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435309:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3000/0xb74d2367a8310cfd lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435319:0:17855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435324:0:17855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435329:0:17855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435352:0:17855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9467838d0a00 already unused, calling callback (ffffffffc191b4f0) 00010000:00010000:1.0:1789121161.435355:0:17855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435362:0:17855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435370:0:17855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:1.0:1789121161.435373:0:17855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789121161.435376:0:17855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.435381:0:17855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9467838d0a00/0xb74d2367a8310cef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121161.435710:0:17855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946889570780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+19:15952:x1876028947579392:12345-192.168.202.32@tcp:57:lhsmtool_posix.0 Request processed in 35213us (35506us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789121161.435721:0:17855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 63 00000020:00080000:1.0:1789121161.435727:0:17855:0:(tgt_main.c:785:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789121161.438817:0:17891:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789121161.438858:0:17891:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789121161.438917:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789121161.438926:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789121161.439099:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121161.439270:0:19756:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947579904 00000100:00100000:1.0:1789121161.439284:0:19756:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947579904 00000100:00100000:1.0:1789121161.439364:0:19756:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:1.0:1789121161.439376:0:19756:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+19:15951:x1876028947579904:12345-192.168.202.32@tcp:101:dd.0 00010000:00010000:1.0:1789121161.439406:0:19756:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789121161.439437:0:19756:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d04 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xac60ebf48fa7ef73 expref: -99 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.439492:0:19756:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310d0b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.440019:0:19756:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310d0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.440048:0:19756:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310d0b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19756 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.440243:0:19756:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d04 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef73 expref: 21 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.440273:0:19756:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3800/0xb74d2367a8310d0b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.32@tcp remote: 0xac60ebf48fa7ef73 expref: 20 pid: 19756 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.440284:0:19756:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff946888a7fa00) 00010000:00010000:1.0:1789121161.440287:0:19756:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789121161.440291:0:19756:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9468b99a3800, rc 0) 00000100:00100000:1.0:1789121161.440391:0:19756:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2c780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7f977f21-a57c-43c4-b0be-1d901bfa40b7+20:15951:x1876028947579904:12345-192.168.202.32@tcp:101:dd.0 Request processed in 1016us (1307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121161.440417:0:19756:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 64 00000100:00100000:3.0:1789121161.454055:0:3637:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:1.0:1789121161.457031:0:17858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947580160 00000100:00100000:1.0:1789121161.457047:0:17858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947580160 00000100:00100000:1.0:1789121161.457118:0:17858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 11 00000100:00100000:1.0:1789121161.457135:0:17858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+20:15952:x1876028947580160:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789121161.457439:0:17858:0:(mdd_object.c:4024:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789121161.457479:0:17858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1789121161.457515:0:17858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d12 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.457531:0:17858:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.457560:0:17858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d12 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.457570:0:17858:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d12 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.457576:0:17858:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d12 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.457583:0:17858:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.457608:0:17858:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789121161.457661:0:17842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789121161.457677:0:17842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d12 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.457688:0:17842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3200 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:0.0:1789121161.457694:0:17842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d12 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.457706:0:17842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d12 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17858 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789121161.457717:0:17858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2e580 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+22:15952:x1876028947580160:12345-192.168.202.32@tcp:35:lhsmtool_posix.0 Request processed in 578us (3671us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1789121161.457729:0:17858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 11 00010000:00010000:0.0:1789121161.457734:0:17842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff946888a7f500) 00000020:00080000:1.0:1789121161.457737:0:17858:0:(tgt_main.c:785:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789121161.457741:0:17842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789121161.457750:0:17842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d12 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.457769:0:17842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9468b99a3200/0xb74d2367a8310d12 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17858 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789121161.457815:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121161.457817:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789121161.457888:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121161.634747:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121161.634796:0:3639:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121161.634893:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947580288 00000100:00100000:3.0:1789121161.634903:0:19372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947580288 00000100:00100000:3.0:1789121161.634965:0:19372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947580416 00000100:00100000:3.0:1789121161.634969:0:19372:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947580416 00000100:00100000:1.0:1789121161.634977:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:1.0:1789121161.634989:0:19371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9467848930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+8:2412:x1876028947580288:12345-192.168.202.32@tcp:4:dd.0 00002000:00010000:1.0:1789121161.635044:0:19371:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x6aa3d288, atime: 0x6aa3d287, ctime: 0x6aa3d288, blocks: 0x0 00010000:00010000:1.0:1789121161.635061:0:19371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2250ec/0xb74d2367a8310d19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.635078:0:19371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=611s v=(0 0) 00010000:00010000:1.0:1789121161.635083:0:19371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789121161.635089:0:19371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f2250ec/0xb74d2367a8310d19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.635121:0:19371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f2250ec/0xb74d2367a8310d19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789121161.683635:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789121161.753796:0:19362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1789121161.753961:0:19362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1789121161.754245:0:19371:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789121161.754283:0:19371:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1789121160 -> 1789121161 00002000:00010000:2.0:1789121161.754287:0:19371:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1789121160 -> 1789121161 00002000:00010000:2.0:1789121161.754291:0:19371:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1789121161.754313:0:19371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f2250ec/0xb74d2367a8310d19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.754325:0:19371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f2250ec/0xb74d2367a8310d19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.754342:0:19371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f2250ec/0xb74d2367a8310d19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.754351:0:19371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468b99a3000 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121161.754356:0:19371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2250ec/0xb74d2367a8310d19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.754369:0:19371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f2250ec/0xb74d2367a8310d19 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.754399:0:19371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f2250ec/0xb74d2367a8310d19 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.754406:0:19371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f2250ec/0xb74d2367a8310d19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121161.755031:0:19371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9467848930c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+6:2412:x1876028947580288:12345-192.168.202.32@tcp:4:dd.0 Request processed in 120031us (120281us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789121161.755052:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 0 00000100:00100000:2.0:1789121161.755112:0:19371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 1 00000100:00100000:2.0:1789121161.755132:0:19371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784891680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947580416:12345-192.168.202.32@tcp:4:dd.0 00002000:00010000:2.0:1789121161.755213:0:19371:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6aa3d289, atime: 0x6aa3d287, ctime: 0x6aa3d289, blocks: 0x2000 00010000:00010000:2.0:1789121161.755224:0:19371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002780039a/0xb74d2367a8310d20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.755242:0:19371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=611s v=(0 0) 00010000:00010000:2.0:1789121161.755247:0:19371:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789121161.755254:0:19371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002780039a/0xb74d2367a8310d20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.755268:0:19371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002780039a/0xb74d2367a8310d20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789121161.822929:0:19362:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1789121161.823314:0:19371:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:2.0:1789121161.823321:0:19371:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:2.0:1789121161.823346:0:19371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002780039a/0xb74d2367a8310d20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.823361:0:19371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002780039a/0xb74d2367a8310d20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.823371:0:19371:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002780039a/0xb74d2367a8310d20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.823379:0:19371:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9468aa990c00 already unused, calling callback (ffffffffc0cd8550) 00010000:00010000:2.0:1789121161.823386:0:19371:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002780039a/0xb74d2367a8310d20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.823434:0:19371:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002780039a/0xb74d2367a8310d20 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.823462:0:19371:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002780039a/0xb74d2367a8310d20 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789121161.823472:0:19371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002780039a/0xb74d2367a8310d20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 19371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789121161.824019:0:19371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784891680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2411:x1876028947580416:12345-192.168.202.32@tcp:4:dd.0 Request processed in 68888us (189212us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789121161.824033:0:19371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 1 00010000:00010000:0.0:1789121162.710102:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789121163.154177:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3645:1876028970731136:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154270:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154343:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970731648:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154376:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154400:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970732160:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154422:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154449:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970732672:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154472:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154503:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1789121163.154509:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970731520:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154538:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154559:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970732032:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154583:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154601:0:3645:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970732544:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154625:0:3645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154657:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970731264:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154687:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154708:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf749a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970731776:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154750:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154772:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970732288:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154797:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154842:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1789121163.154849:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946783d1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970731392:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154875:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154896:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970731904:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154919:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154938:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970732416:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.154964:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789121163.154995:0:17847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970731136 00000100:00100000:1.0:1789121163.155004:0:17847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970731136 00000100:00100000:1.0:1789121163.155059:0:17847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789121163.155069:0:17847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3645:x1876028970731136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.155123:0:17847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee+24:3645:x1876028970731136:12345-0@lo:400:kworker.0 Request processed in 54us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.155132:0:17847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789121163.155177:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970731648 00000100:00100000:1.0:1789121163.155181:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970731648 00000100:00100000:1.0:1789121163.155204:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970732160 00000100:00100000:1.0:1789121163.155207:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970732160 00000100:00100000:1.0:1789121163.155221:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970732672 00000100:00100000:1.0:1789121163.155224:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970732672 00000100:00100000:1.0:1789121163.155243:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970732544 00000100:00100000:1.0:1789121163.155246:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970732544 00000100:00100000:1.0:1789121163.155258:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970732288 00000100:00100000:1.0:1789121163.155261:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970732288 00000100:00100000:1.0:1789121163.155272:0:19755:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970732416 00000100:00100000:1.0:1789121163.155282:0:19755:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970732416 00000100:00100000:1.0:1789121163.155302:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789121163.155308:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970731648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.155344:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf749e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1876028970731648:12345-0@lo:400:kworker.0 Request processed in 37us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.155351:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789121163.155365:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789121163.155371:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970732160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.155400:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1876028970732160:12345-0@lo:400:kworker.0 Request processed in 29us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.155406:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789121163.155419:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789121163.155425:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970732672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.155455:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748780 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1876028970732672:12345-0@lo:400:kworker.0 Request processed in 30us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.155461:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789121163.155473:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789121163.155479:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970732544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.155507:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf748f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1876028970732544:12345-0@lo:400:kworker.0 Request processed in 28us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.155514:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789121163.155525:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789121163.155531:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2ead680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970732288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.155565:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2ead680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1876028970732288:12345-0@lo:400:kworker.0 Request processed in 34us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.155581:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789121163.155594:0:19755:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789121163.155601:0:19755:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970732416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.155629:0:19755:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eafc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1876028970732416:12345-0@lo:400:kworker.0 Request processed in 30us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.155635:0:19755:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789121163.155659:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970731520 00000100:00100000:1.0:1789121163.155663:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970731520 00000100:00100000:1.0:1789121163.155685:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970732032 00000100:00100000:1.0:1789121163.155688:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970732032 00000100:00100000:1.0:1789121163.155698:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970731392 00000100:00100000:1.0:1789121163.155700:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970731392 00000100:00100000:1.0:1789121163.155708:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970731904 00000100:00100000:1.0:1789121163.155710:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970731904 00000100:00100000:1.0:1789121163.155721:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789121163.155727:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970731520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.155757:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74a940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1876028970731520:12345-0@lo:400:kworker.0 Request processed in 31us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.155764:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789121163.155775:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789121163.155781:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf7492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970732032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.155851:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf7492c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1876028970732032:12345-0@lo:400:kworker.0 Request processed in 70us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.155857:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789121163.155869:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789121163.155875:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970731392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.155912:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eacb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970731392:12345-0@lo:400:kworker.0 Request processed in 38us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.155918:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789121163.155930:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789121163.155936:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970731904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.155962:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eade00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970731904:12345-0@lo:400:kworker.0 Request processed in 27us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.155968:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789121163.155990:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970731264 00000100:00100000:1.0:1789121163.155994:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970731264 00000100:00100000:1.0:1789121163.156019:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970731776 00000100:00100000:1.0:1789121163.156022:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970731776 00000100:00100000:1.0:1789121163.156035:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789121163.156041:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970731264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156075:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468bf74b840 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970731264:12345-0@lo:400:kworker.0 Request processed in 34us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.156082:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789121163.156094:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789121163.156101:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468a2eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970731776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156127:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468a2eac3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1876028970731776:12345-0@lo:400:kworker.0 Request processed in 27us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789121163.156132:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789121163.156205:0:3646:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:1.0:1789121163.156214:0:3646:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff946783d5c3c0, transno 8589934596 00000004:00080000:1.0:1789121163.156236:0:3646:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:1.0:1789121163.156266:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970731392:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156292:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970731904:0@lo:400:kworker.0 00010000:00080000:1.0:1789121163.156304:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf748000 x1876028970732416/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121163.156315:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3646:1876028970732416:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156323:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d192c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970731264:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156331:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf749a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3646:1876028970731776:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156341:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3646:1876028970732288:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156384:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3645:1876028970731520:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156396:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf7483c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3645:1876028970732032:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156409:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3645:1876028970732544:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156419:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946783d1bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:057e0b0e-c04f-45aa-a41a-bc7b139fb1ee:3645:1876028970731136:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156432:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf749680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3645:1876028970731648:0@lo:400:kworker.0 00000100:00100000:1.0:1789121163.156446:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3645:1876028970732160:0@lo:400:kworker.0 00010000:00080000:1.0:1789121163.156459:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9468bf74a1c0 x1876028970732672/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789121179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789121163.156469:0:3645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9468bf74a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3645:1876028970732672:0@lo:400:kworker.0 00000100:00080000:3.0:1789121163.156804:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789121163.156810:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789121163.156813:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789121163.156815:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789121163.156843:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789121163.156856:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970732800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789121163.156906:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121163.156949:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970732800 00000100:00100000:3.0:1789121163.156955:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970732800 00000100:00100000:3.0:1789121163.156990:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789121163.156998:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970732800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789121163.157022:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789121163.157061:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2c3c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1876028970732800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121163.157078:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789121163.157121:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3647:1876028970732800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789121163.157961:0:3647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970732928:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789121163.158015:0:3647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121163.158087:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970732928 00000100:00100000:3.0:1789121163.158092:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970732928 00000100:00100000:3.0:1789121163.158131:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789121163.158139:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970732928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789121163.158155:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923509248 avail 3691986944 00000100:00100000:3.0:1789121163.158203:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9c39a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1876028970732928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 65us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121163.158210:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789121163.158281:0:3647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784b2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3647:1876028970732928:0@lo:13:osp-pre-1-1.0 00000001:02000400:2.0:1789121163.703545:0:21043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1789121163.730145:0:17843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789121164.242927:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121164.242970:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121164.242996:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121164.243026:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121164.243041:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121164.243054:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:2.0:1789121164.243168:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947581056 00000100:00100000:2.0:1789121164.243179:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947581056 00000100:00100000:2.0:1789121164.243240:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947581568 00000100:00100000:2.0:1789121164.243243:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947581568 00000100:00100000:2.0:1789121164.243264:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:2.0:1789121164.243273:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2412:x1876028947581056:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121164.243348:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2d2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2412:x1876028947581056:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 77us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121164.243356:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 28 00000100:00100000:2.0:1789121164.243373:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00100000:2.0:1789121164.243379:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783b04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2412:x1876028947581568:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121164.243420:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783b04b40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2412:x1876028947581568:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 41us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121164.243426:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 29 00000100:00080000:2.0:1789121164.243461:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789121164.243547:0:17849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947580544 00000100:00100000:0.0:1789121164.243551:0:17849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947580544 00000100:00100000:0.0:1789121164.243593:0:17849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:0.0:1789121164.243601:0:17849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9468b9d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+13:2412:x1876028947580544:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121164.243628:0:17849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9468b9d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d42aa198-48db-4e57-bdde-271b173b12cf+13:2412:x1876028947580544:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 28us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121164.243634:0:17849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 167 00000100:00100000:3.0:1789121164.243749:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121164.243864:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:3.0:1789121164.243913:0:3638:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.32@tcp (source: 12345-192.168.202.32@tcp) 00000100:00100000:0.0:1789121164.244037:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947580800 00000100:00100000:0.0:1789121164.244042:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947580800 00000100:00100000:0.0:1789121164.244091:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947581312 00000100:00100000:0.0:1789121164.244095:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947581312 00000100:00100000:0.0:1789121164.244109:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947580672 00000100:00100000:0.0:1789121164.244112:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947580672 00000100:00100000:0.0:1789121164.244127:0:17854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947581184 00000100:00100000:0.0:1789121164.244129:0:17854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947581184 00000100:00100000:0.0:1789121164.244145:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:0.0:1789121164.244150:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2412:x1876028947580800:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121164.244207:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784b2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2412:x1876028947580800:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 56us (1236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121164.244214:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 66 00000100:00100000:0.0:1789121164.244229:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:0.0:1789121164.244235:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2412:x1876028947581312:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121164.244260:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783c2ed00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2412:x1876028947581312:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121164.244266:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 67 00000100:00100000:0.0:1789121164.244277:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:0.0:1789121164.244283:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+22:2412:x1876028947580672:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121164.244314:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7f977f21-a57c-43c4-b0be-1d901bfa40b7+22:2412:x1876028947580672:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 29us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121164.244321:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 68 00000100:00100000:0.0:1789121164.244333:0:17854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:0.0:1789121164.244339:0:17854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2412:x1876028947581184:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:0.0:1789121164.244364:0:17854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5d680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0d1c643e-f8d1-4998-bc1e-8baa38374a62+6:2412:x1876028947581184:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 25us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121164.244369:0:17854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 69 00000100:00100000:2.0:1789121164.244661:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947580928 00000100:00100000:2.0:1789121164.244666:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947580928 00000100:00100000:2.0:1789121164.244692:0:19367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028947581440 00000100:00100000:2.0:1789121164.244695:0:19367:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028947581440 00000100:00100000:2.0:1789121164.244710:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:2.0:1789121164.244717:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2412:x1876028947580928:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121164.244760:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d5c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7f977f21-a57c-43c4-b0be-1d901bfa40b7+5:2412:x1876028947580928:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 43us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121164.244766:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 30 00000100:00100000:2.0:1789121164.244779:0:19367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00100000:2.0:1789121164.244785:0:19367:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2412:x1876028947581440:12345-192.168.202.32@tcp:400:kworker.0 00000100:00100000:2.0:1789121164.244807:0:19367:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1cb40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0d1c643e-f8d1-4998-bc1e-8baa38374a62+5:2412:x1876028947581440:12345-192.168.202.32@tcp:400:kworker.0 Request processed in 23us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121164.244811:0:19367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.32@tcp, seq: 31 00000100:00080000:3.0:1789121164.244963:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789121164.244967:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789121164.244969:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1789121164.757143:0:17842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789121165.208795:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970733056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789121165.208899:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121165.208957:0:3644:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789121165.208963:0:3644:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970733184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789121165.208990:0:3644:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789121165.209030:0:18598:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970733056 00000100:00100000:2.0:1789121165.209039:0:18598:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970733056 00000100:00100000:2.0:1789121165.209132:0:18598:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789121165.209142:0:18598:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970733056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789121165.209191:0:18598:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789121165.209245:0:18598:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784893c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970733056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 104us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121165.209252:0:18598:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789121165.209278:0:19369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970733184 00000100:00100000:2.0:1789121165.209282:0:19369:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970733184 00000100:00100000:2.0:1789121165.209334:0:19369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789121165.209340:0:19369:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946784892940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970733184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789121165.209360:0:19369:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915845632 avail 3684323328 00000100:00100000:2.0:1789121165.209390:0:19369:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946784892940 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3644:x1876028970733184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 51us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789121165.209397:0:19369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789121165.209418:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789121165.209457:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970733184:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789121165.209473:0:3644:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3644:1876028970733056:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789121165.216578:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970733312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789121165.216663:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121165.216714:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789121165.216736:0:3646:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970733440:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789121165.216781:0:3646:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789121165.216842:0:17859:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970733440 00000100:00100000:3.0:1789121165.216849:0:17859:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970733440 00000100:00100000:3.0:1789121165.216899:0:17859:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789121165.216908:0:17859:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970733440:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789121165.216944:0:17859:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789121165.216988:0:17859:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970733440:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1789121165.216995:0:17859:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789121165.217045:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784891e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970733440:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789121165.217679:0:19370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876028970733312 00000100:00100000:0.0:1789121165.217686:0:19370:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876028970733312 00000100:00100000:0.0:1789121165.217727:0:19370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789121165.217735:0:19370:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff946783d1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970733312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789121165.217753:0:19370:0:(ofd_obd.c:739:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915845632 avail 3684323328 00000100:00100000:0.0:1789121165.217888:0:19370:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff946783d1d680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1876028970733312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (1225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789121165.217895:0:19370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1789121165.218031:0:17850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789121165.218074:0:3646:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff946784892580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3646:1876028970733312:0@lo:13:osp-pre-0-0.0 Debug log: 44967 lines, 44967 kept, 0 dropped, 0 bad.